May 29 13:42:29.397526 ip-10-0-139-221 systemd[1]: Starting Kubernetes Kubelet...
May 29 13:42:29.845180 ip-10-0-139-221 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 13:42:29.845180 ip-10-0-139-221 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 13:42:29.845180 ip-10-0-139-221 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 13:42:29.845180 ip-10-0-139-221 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 13:42:29.845180 ip-10-0-139-221 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 13:42:29.846952 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.846827    2549 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 13:42:29.850693 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850678    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 13:42:29.850693 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850693    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850696    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850700    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850703    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850706    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850709    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850712    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850715    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850717    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850720    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850723    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850726    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850729    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850731    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850734    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850736    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850739    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850742    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850745    2549 feature_gate.go:328] unrecognized feature gate: Example
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850747    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 13:42:29.850753 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850755    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850759    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850761    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850764    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850767    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850769    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850772    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850775    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850777    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850780    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850782    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850785    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850787    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850790    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850792    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850795    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850797    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850800    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850802    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850805    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 13:42:29.851230 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850807    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850810    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850812    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850814    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850817    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850819    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850822    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850824    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850827    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850829    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850832    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850834    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850837    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850840    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850844    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850846    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850849    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850851    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850854    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850856    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 13:42:29.851718 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850859    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850861    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850864    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850866    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850869    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850871    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850874    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850876    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850879    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850881    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850886    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850890    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850893    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850896    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850900    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850902    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850905    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850909    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 13:42:29.852217 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850912    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850915    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850918    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850920    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850923    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850925    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.850928    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851305    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851313    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851316    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851319    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851322    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851325    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851327    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851330    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851332    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851335    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851338    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851341    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851343    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 13:42:29.852657 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851345    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851348    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851351    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851353    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851355    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851358    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851361    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851364    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851366    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851369    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851371    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851373    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851376    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851379    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851381    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851383    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851386    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851388    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851391    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 13:42:29.853124 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851393    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851398    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851402    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851405    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851408    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851410    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851413    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851416    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851418    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851421    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851423    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851426    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851428    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851431    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851433    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851435    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851438    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851442    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851444    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 13:42:29.853634 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851447    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851449    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851453    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851455    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851458    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851461    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851463    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851466    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851469    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851471    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851474    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851476    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851479    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851482    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851485    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851489    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851492    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851494    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851497    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851499    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 13:42:29.854134 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851502    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851504    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851507    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851510    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851513    2549 feature_gate.go:328] unrecognized feature gate: Example
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851515    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851518    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851520    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851522    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851525    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851527    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851530    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851532    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851535    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.851537    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851619    2549 flags.go:64] FLAG: --address="0.0.0.0"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851630    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851638    2549 flags.go:64] FLAG: --anonymous-auth="true"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851645    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851657    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851661    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 13:42:29.854646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851666    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851670    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851674    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851677    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851680    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851684    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851687    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851690    2549 flags.go:64] FLAG: --cgroup-root=""
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851693    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851696    2549 flags.go:64] FLAG: --client-ca-file=""
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851699    2549 flags.go:64] FLAG: --cloud-config=""
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851702    2549 flags.go:64] FLAG: --cloud-provider="external"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851705    2549 flags.go:64] FLAG: --cluster-dns="[]"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851709    2549 flags.go:64] FLAG: --cluster-domain=""
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851712    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851715    2549 flags.go:64] FLAG: --config-dir=""
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851718    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851722    2549 flags.go:64] FLAG: --container-log-max-files="5"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851726    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851729    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851733    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851736    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851739    2549 flags.go:64] FLAG: --contention-profiling="false"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851742    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 13:42:29.855144 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851745    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851748    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851751    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851756    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851759    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851762    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851765    2549 flags.go:64] FLAG: --enable-load-reader="false"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851768    2549 flags.go:64] FLAG: --enable-server="true"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851771    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851775    2549 flags.go:64] FLAG: --event-burst="100"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851778    2549 flags.go:64] FLAG: --event-qps="50"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851781    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851787    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851790    2549 flags.go:64] FLAG: --eviction-hard=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851794    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851797    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851800    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851803    2549 flags.go:64] FLAG: --eviction-soft=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851806    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851809    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851812    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851815    2549 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851818    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851821    2549 flags.go:64] FLAG: --fail-swap-on="true"
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851823    2549 flags.go:64] FLAG: --feature-gates=""
May 29 13:42:29.855744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851827    2549 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851830    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851833    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851836    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851839    2549 flags.go:64] FLAG: --healthz-port="10248"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851842    2549 flags.go:64] FLAG: --help="false"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851845    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-139-221.ec2.internal"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851848    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851851    2549 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851854    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851857    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851861    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851864    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851866    2549 flags.go:64] FLAG: --image-service-endpoint=""
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851869    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851872    2549 flags.go:64] FLAG: --kube-api-burst="100"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851875    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851878    2549 flags.go:64] FLAG: --kube-api-qps="50"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851880    2549 flags.go:64] FLAG: --kube-reserved=""
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851886    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851889    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851892    2549 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851895    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851898    2549 flags.go:64] FLAG: --lock-file=""
May 29 13:42:29.856371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851901    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851904    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851907    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851912    2549 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851915    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851918    2549 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851920    2549 flags.go:64] FLAG: --logging-format="text"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851923    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851926    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851929    2549 flags.go:64] FLAG: --manifest-url=""
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851932    2549 flags.go:64] FLAG: --manifest-url-header=""
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851936    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851939    2549 flags.go:64] FLAG: --max-open-files="1000000"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851943    2549 flags.go:64] FLAG: --max-pods="110"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851946    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851948    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851951    2549 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851954    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851957    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851960    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851966    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851974    2549 flags.go:64] FLAG: --node-status-max-images="50"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851977    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851980    2549 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 13:42:29.856940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851982    2549 flags.go:64] FLAG: --pod-cidr=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851985    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851991    2549 flags.go:64] FLAG: --pod-manifest-path=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851995    2549 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.851999    2549 flags.go:64] FLAG: --pods-per-core="0"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852002    2549 flags.go:64] FLAG: --port="10250"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852005    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852008    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e0583926dbba155"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852011    2549 flags.go:64] FLAG: --qos-reserved=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852014    2549 flags.go:64] FLAG: --read-only-port="10255"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852017    2549 flags.go:64] FLAG: --register-node="true"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852020    2549 flags.go:64] FLAG: --register-schedulable="true"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852023    2549 flags.go:64] FLAG: --register-with-taints=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852026    2549 flags.go:64] FLAG: --registry-burst="10"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852029    2549 flags.go:64] FLAG: --registry-qps="5"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852032    2549 flags.go:64] FLAG: --reserved-cpus=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852035    2549 flags.go:64] FLAG: --reserved-memory=""
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852038    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852041    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852044    2549 flags.go:64] FLAG: --rotate-certificates="false"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852047    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852049    2549 flags.go:64] FLAG: --runonce="false"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852052    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852055    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852058    2549 flags.go:64] FLAG: --seccomp-default="false"
May 29 13:42:29.857541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852061    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852064    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852066    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852070    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852073    2549 flags.go:64] FLAG: --storage-driver-password="root"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852076    2549 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852078    2549 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852081    2549 flags.go:64] FLAG: --storage-driver-user="root"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852084    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852087    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852094    2549 flags.go:64] FLAG: --system-cgroups=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852098    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852103    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852106    2549 flags.go:64] FLAG: --tls-cert-file=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852109    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852113    2549 flags.go:64] FLAG: --tls-min-version=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852116    2549 flags.go:64] FLAG: --tls-private-key-file=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852119    2549 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852121    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852125    2549 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852128    2549 flags.go:64] FLAG: --v="2"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852132    2549 flags.go:64] FLAG: --version="false"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852136    2549 flags.go:64] FLAG: --vmodule=""
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852140    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.852143    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 13:42:29.858133 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852238    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852241    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852244    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852247    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852250    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852253    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852255    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852270    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852273    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852276    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852278    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852281    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852285    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852289    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852292    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852295    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852297    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852302    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852306    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 13:42:29.858792 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852309    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852311    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852314    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852316    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852319    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852322    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852324    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852327    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852329    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852332    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852335    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852337    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852340    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852342    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852345    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852347    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852350    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852353    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852355    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852358    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 13:42:29.859243 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852361    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852364    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852368    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852370    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852373    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852375    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852378    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852381    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852383    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852386    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852389    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852393    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852395    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852398    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852400    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852403    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852405    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852408    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852411    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 13:42:29.859798 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852414    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852416    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852418    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852421    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852424    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852426    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852429    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852431    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852434    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852436    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852439    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852441    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852444    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852446    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852449    2549 feature_gate.go:328] unrecognized feature gate: Example
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852451    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852454    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852456    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852459    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852461    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 13:42:29.860283 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852464    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852467    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852469    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852473    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852477    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852480    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852483    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.852485    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.853378    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.859586    2549 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.859601    2549 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859654    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859661    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859665    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859668    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 13:42:29.860767 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859673    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859677    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859680    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859683    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859685    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859688    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859691    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859693    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859696    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859699    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859701    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859704    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859707    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859709    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859712    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859714    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859717    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859719    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859722    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 13:42:29.861130 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859725    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859727    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859730    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859733    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859735    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859738    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859741    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859743    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859748    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859750    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859753    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859755    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859758    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859761    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859763    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859766    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859768    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859771    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859773    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859776    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 13:42:29.861619 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859779    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859781    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859784    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859788    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859792    2549 feature_gate.go:328] unrecognized feature gate: Example
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859795    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859798    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859801    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859804    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859806    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859809    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859812    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859814    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859817    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859820    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859823    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859825    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859828    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859830    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859833    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 13:42:29.862112 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859837    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859840    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859843    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859846    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859848    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859851    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859853    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859856    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859858    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859861    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859863    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859865    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859868    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859870    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859873    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859875    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859878    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859881    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859883    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859885    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 13:42:29.862607 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859888    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859890    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859893    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.859898    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859995    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.859999    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860003    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860006    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860008    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860011    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860014    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860017    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860020    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860023    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860026    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860029    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 13:42:29.863128 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860032    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860035    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860038    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860042    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860045    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860048    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860051    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860053    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860056    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860059    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860061    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860064    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860066    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860069    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860071    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860074    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860076    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860079    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860081    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860084    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 13:42:29.863527 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860087    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860089    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860092    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860094    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860096    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860099    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860101    2549 feature_gate.go:328] unrecognized feature gate: Example2
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860104    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860106    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860109    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860112    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860116    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860119    2549 feature_gate.go:328] unrecognized feature gate: Example
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860121    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860124    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860126    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860129    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860132    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860134    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860136    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 13:42:29.864010 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860139    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860141    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860144    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860146    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860148    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860151    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860153    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860156    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860158    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860161    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860163    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860166    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860168    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860171    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860174    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860176    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860178    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860181    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860183    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860186    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 13:42:29.864520 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860188    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860192    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860194    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860197    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860199    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860202    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860204    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860207    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860209    2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860212    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860216    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860219    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860222    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:29.860224    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.860229    2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 13:42:29.864998 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.861376    2549 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 13:42:29.867658 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.867644    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 13:42:29.868699 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.868687    2549 server.go:1019] "Starting client certificate rotation"
May 29 13:42:29.868812 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.868793    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 13:42:29.868842 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.868829    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 13:42:29.895270 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.895245    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 13:42:29.898438 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.898418    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 13:42:29.917557 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.917536    2549 log.go:25] "Validated CRI v1 runtime API"
May 29 13:42:29.922304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.922288    2549 log.go:25] "Validated CRI v1 image API"
May 29 13:42:29.923501 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.923485    2549 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 13:42:29.926978 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.926955    2549 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae108b7c-21cf-458a-853a-73e3098d01e0:/dev/nvme0n1p4 cb0dde1e-2705-4ee4-be8c-c83f85af5043:/dev/nvme0n1p3]
May 29 13:42:29.927040 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.926976    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 13:42:29.931171 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.931063    2549 manager.go:217] Machine: {Timestamp:2026-05-29 13:42:29.930578819 +0000 UTC m=+0.412823287 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096628 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c2af36050ce8ea643598729d9f849 SystemUUID:ec2c2af3-6050-ce8e-a643-598729d9f849 BootID:87056be9-b24c-4dda-ac78-b75cc756a421 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:2e:e7:37:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:2e:e7:37:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:51:f9:9a:2a:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 13:42:29.931171 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.931158    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 13:42:29.931331 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.931228    2549 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 13:42:29.932877 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.932850    2549 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 13:42:29.933005 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.932879    2549 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 13:42:29.933047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.933014    2549 topology_manager.go:138] "Creating topology manager with none policy"
May 29 13:42:29.933047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.933023    2549 container_manager_linux.go:306] "Creating device plugin manager"
May 29 13:42:29.933047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.933030    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 13:42:29.933047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.933040    2549 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 13:42:29.934429 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.934419    2549 state_mem.go:36] "Initialized new in-memory state store"
May 29 13:42:29.934532 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.934523    2549 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 13:42:29.937354 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.937344    2549 kubelet.go:491] "Attempting to sync node with API server"
May 29 13:42:29.937394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.937357    2549 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 13:42:29.937394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.937368    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 13:42:29.937394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.937376    2549 kubelet.go:397] "Adding apiserver pod source"
May 29 13:42:29.937394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.937385    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 13:42:29.938472 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.938460    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 13:42:29.938509 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.938479    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 13:42:29.941429 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.941411    2549 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 29 13:42:29.943226 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.943213    2549 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 13:42:29.944646 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.944626    2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 13:42:29.945201 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945190    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 13:42:29.945247 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945211    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 13:42:29.945247 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945221    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 13:42:29.945247 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945229    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 13:42:29.945247 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945238    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 13:42:29.945247 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945244    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945250    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945256    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945281    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945288    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945309    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 13:42:29.945399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.945316    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 13:42:29.947291 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.947280    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 13:42:29.947291 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.947292    2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 13:42:29.950250 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.950237    2549 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 13:42:29.950319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.950293    2549 server.go:1295] "Started kubelet"
May 29 13:42:29.950623 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.950500    2549 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 13:42:29.950699 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.950654    2549 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 13:42:29.951050 ip-10-0-139-221 systemd[1]: Started Kubernetes Kubelet.
May 29 13:42:29.951543 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.951393    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 13:42:29.951543 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.951486    2549 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 29 13:42:29.951650 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.951567    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 13:42:29.951780 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.951665    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 13:42:29.951912 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.951863    2549 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 13:42:29.957686 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.957667    2549 server.go:317] "Adding debug handlers to kubelet server"
May 29 13:42:29.959824 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.959809    2549 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 13:42:29.960770 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.960752    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 13:42:29.961340 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961321    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 13:42:29.961477 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.960410    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-221.ec2.internal.18b40d181de718b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-221.ec2.internal,UID:ip-10-0-139-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-221.ec2.internal,},FirstTimestamp:2026-05-29 13:42:29.950249144 +0000 UTC m=+0.432493613,LastTimestamp:2026-05-29 13:42:29.950249144 +0000 UTC m=+0.432493613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-221.ec2.internal,}"
May 29 13:42:29.961627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961612    2549 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 13:42:29.961681 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961628    2549 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 13:42:29.961779 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961767    2549 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 13:42:29.961831 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961813    2549 reconstruct.go:97] "Volume reconstruction finished"
May 29 13:42:29.961831 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.961822    2549 reconciler.go:26] "Reconciler: start to sync state"
May 29 13:42:29.962294 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.962239    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:29.962405 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962388    2549 factory.go:153] Registering CRI-O factory
May 29 13:42:29.962405 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962407    2549 factory.go:223] Registration of the crio container factory successfully
May 29 13:42:29.962516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962462    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 13:42:29.962516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962474    2549 factory.go:55] Registering systemd factory
May 29 13:42:29.962516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962485    2549 factory.go:223] Registration of the systemd container factory successfully
May 29 13:42:29.962516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962504    2549 factory.go:103] Registering Raw factory
May 29 13:42:29.962516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.962517    2549 manager.go:1196] Started watching for new ooms in manager
May 29 13:42:29.963083 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.963070    2549 manager.go:319] Starting recovery of all containers
May 29 13:42:29.966559 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.966527    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 29 13:42:29.966650 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.966559    2549 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 29 13:42:29.970827 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.970804    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fc46c"
May 29 13:42:29.973585 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.973473    2549 manager.go:324] Recovery completed
May 29 13:42:29.976916 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.976898    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fc46c"
May 29 13:42:29.977296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.977284    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:29.978969 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.978956    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:29.979021 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.978979    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:29.979021 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.978988    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:29.979534 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.979522    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 13:42:29.979534 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.979532    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 13:42:29.979641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.979547    2549 state_mem.go:36] "Initialized new in-memory state store"
May 29 13:42:29.981140 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:29.981078    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-221.ec2.internal.18b40d181f9d524e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-221.ec2.internal,UID:ip-10-0-139-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-221.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-221.ec2.internal,},FirstTimestamp:2026-05-29 13:42:29.978968654 +0000 UTC m=+0.461213124,LastTimestamp:2026-05-29 13:42:29.978968654 +0000 UTC m=+0.461213124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-221.ec2.internal,}"
May 29 13:42:29.981827 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.981816    2549 policy_none.go:49] "None policy: Start"
May 29 13:42:29.981874 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.981832    2549 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 13:42:29.981874 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:29.981842    2549 state_mem.go:35] "Initializing new in-memory state store"
May 29 13:42:30.018594 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.018579    2549 manager.go:341] "Starting Device Plugin manager"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.018610    2549 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.018620    2549 server.go:85] "Starting device plugin registration server"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.018867    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.018881    2549 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.019006    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.019063    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.019071    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.020920    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 13:42:30.038296 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.020958    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.100326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.100253    2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 13:42:30.101375 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.101361    2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 13:42:30.101460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.101384    2549 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 13:42:30.101460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.101406    2549 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 13:42:30.101460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.101415    2549 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 13:42:30.101460 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.101456    2549 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 13:42:30.104446 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.104429    2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 13:42:30.119088 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.119075    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:30.119834 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.119810    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:30.119920 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.119840    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:30.119920 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.119852    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:30.119920 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.119881    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-221.ec2.internal"
May 29 13:42:30.128423 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.128405    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-221.ec2.internal"
May 29 13:42:30.128473 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.128424    2549 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-221.ec2.internal\": node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.153151 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.153137    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.201690 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.201671    2549 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"]
May 29 13:42:30.201742 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.201723    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:30.202626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.202612    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:30.202687 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.202640    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:30.202687 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.202650    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:30.203953 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.203942    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:30.204127 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204112    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.204173 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204143    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:30.204748 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204728    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:30.204838 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204761    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:30.204838 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204728    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:30.204838 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204772    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:30.204838 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204793    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:30.204838 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.204805    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:30.206153 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.206135    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.206245 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.206157    2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 13:42:30.206859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.206834    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientMemory"
May 29 13:42:30.206925 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.206862    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasNoDiskPressure"
May 29 13:42:30.206925 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.206872    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeHasSufficientPID"
May 29 13:42:30.239780 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.239755    2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-221.ec2.internal\" not found" node="ip-10-0-139-221.ec2.internal"
May 29 13:42:30.243060 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.243046    2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-221.ec2.internal\" not found" node="ip-10-0-139-221.ec2.internal"
May 29 13:42:30.254105 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.254084    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.263952 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.263936    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.264013 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.263963    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.264013 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.263982    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9dce095611a9775221d01535f4957b7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-221.ec2.internal\" (UID: \"b9dce095611a9775221d01535f4957b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.354305 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.354257    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.364598 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364572    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9dce095611a9775221d01535f4957b7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-221.ec2.internal\" (UID: \"b9dce095611a9775221d01535f4957b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.364715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364612    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.364715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364635    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9dce095611a9775221d01535f4957b7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-221.ec2.internal\" (UID: \"b9dce095611a9775221d01535f4957b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.364715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364638    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.364715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364701    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.364715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.364707    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/04184eb0664bd9f33475028c5e88f897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal\" (UID: \"04184eb0664bd9f33475028c5e88f897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.454987 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.454952    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.542421 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.542390    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.545971 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.545954    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:30.555515 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.555497    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.656053 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.655983    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.756459 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.756435    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.856907 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.856886    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.869323 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.869311    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 13:42:30.869459 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.869444    2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 13:42:30.957678 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:30.957648    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:30.961822 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.961802    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 13:42:30.978543 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.978509    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 13:37:29 +0000 UTC" deadline="2027-11-11 10:14:22.606912642 +0000 UTC"
May 29 13:42:30.978543 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.978536    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12740h31m51.628379358s"
May 29 13:42:30.979674 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:30.979658    2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 13:42:31.004343 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.004319    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dddr"
May 29 13:42:31.010783 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.010766    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5dddr"
May 29 13:42:31.024841 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:31.024811    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04184eb0664bd9f33475028c5e88f897.slice/crio-e249427428ff7d78d33195b9c187edaab8321f0106762dfcde6b9a69b055309f WatchSource:0}: Error finding container e249427428ff7d78d33195b9c187edaab8321f0106762dfcde6b9a69b055309f: Status 404 returned error can't find the container with id e249427428ff7d78d33195b9c187edaab8321f0106762dfcde6b9a69b055309f
May 29 13:42:31.025070 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:31.025042    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9dce095611a9775221d01535f4957b7.slice/crio-b577a35b58bea9a88488dbedc8c6a7e1b5d69d6eba81fb5859ca4e660ea67dfa WatchSource:0}: Error finding container b577a35b58bea9a88488dbedc8c6a7e1b5d69d6eba81fb5859ca4e660ea67dfa: Status 404 returned error can't find the container with id b577a35b58bea9a88488dbedc8c6a7e1b5d69d6eba81fb5859ca4e660ea67dfa
May 29 13:42:31.028932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.028917    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 13:42:31.058204 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:31.058174    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:31.104198 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.104158    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal" event={"ID":"04184eb0664bd9f33475028c5e88f897","Type":"ContainerStarted","Data":"e249427428ff7d78d33195b9c187edaab8321f0106762dfcde6b9a69b055309f"}
May 29 13:42:31.104992 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.104973    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal" event={"ID":"b9dce095611a9775221d01535f4957b7","Type":"ContainerStarted","Data":"b577a35b58bea9a88488dbedc8c6a7e1b5d69d6eba81fb5859ca4e660ea67dfa"}
May 29 13:42:31.159142 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:31.159125    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:31.259663 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:31.259607    2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-221.ec2.internal\" not found"
May 29 13:42:31.268296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.268279    2549 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 13:42:31.362050 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.362029    2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal"
May 29 13:42:31.392484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.392464    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 13:42:31.394089 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.394075    2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal"
May 29 13:42:31.402080 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.402065    2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 13:42:31.416075 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.416056    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 13:42:31.421120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.421106    2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 13:42:31.764858 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.764831    2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 13:42:31.939655 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.939629    2549 apiserver.go:52] "Watching apiserver"
May 29 13:42:31.948919 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.948893    2549 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 13:42:31.950143 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.950116    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-6dspt","openshift-network-diagnostics/network-check-target-878zh","openshift-network-operator/iptables-alerter-t5dww","kube-system/konnectivity-agent-bcrfd","kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z9nbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-bthnm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf","openshift-dns/node-resolver-w9b22","openshift-image-registry/node-ca-kp9zf","openshift-multus/multus-additional-cni-plugins-7nvs5","openshift-multus/multus-n8dlm"]
May 29 13:42:31.952897 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.952875    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:31.954018 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.953990    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:31.954104 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:31.954056    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:31.955160 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.955140    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:31.955302 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.955280    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:31.955377 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.955354    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 13:42:31.955545 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.955526    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltcdh\""
May 29 13:42:31.955616 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.955531    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 13:42:31.957507 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.957485    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 13:42:31.957592 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.957532    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 13:42:31.957836 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.957818    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 13:42:31.958102 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.958081    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.958177 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.958113    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 13:42:31.958311 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.958294    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7hggn\""
May 29 13:42:31.958477 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.958461    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6cjbk\""
May 29 13:42:31.958700 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.958670    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 13:42:31.959718 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.959700    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.960360 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.959820    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.961792 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.961769    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.961988    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962225    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5jj8l\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962403    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962501    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962563    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962597    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962729    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962846    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vl45n\""
May 29 13:42:31.962859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962853    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 13:42:31.963325 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.962939    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 13:42:31.963325 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.963119    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 13:42:31.963325 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.963167    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bzqgh\""
May 29 13:42:31.963512 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.963474    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 13:42:31.964485 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.964140    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:31.964485 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.964166    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:31.964485 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:31.964204    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:31.966382 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.966366    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r6rvh\""
May 29 13:42:31.966479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.966415    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 13:42:31.966536 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.966491    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 13:42:31.966613 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.966596    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 13:42:31.966997 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.966978    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:31.968636 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.968619    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8dlm"
May 29 13:42:31.969074 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.968990    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 13:42:31.969486 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.969462    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 13:42:31.969650 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.969631    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 13:42:31.969710 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.969655    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 13:42:31.969779 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.969754    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 13:42:31.969779 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.969775    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q2ncd\""
May 29 13:42:31.971093 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.970664    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 13:42:31.971093 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.970930    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5dvpd\""
May 29 13:42:31.974783 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974757    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-tmp\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.974890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974793    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-device-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.974890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974819    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-sys-fs\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.974890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974844    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974928    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm4vh\" (UniqueName: \"kubernetes.io/projected/557e09c2-7c01-4247-89c2-107680229bf9-kube-api-access-tm4vh\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:31.975047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.974999    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqq6\" (UniqueName: \"kubernetes.io/projected/d4b8ca7c-2356-48d5-865d-36dd576a7e11-kube-api-access-wbqq6\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.975199 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975028    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.975199 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975087    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-netns\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975199 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975142    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-etc-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975182    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-node-log\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975228    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b0eb66-6444-4922-ada3-55376f15e9d3-ovn-node-metrics-cert\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975282    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f787ca-b616-467a-9bba-c22e3af4259a-host-slash\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:31.975414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975314    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm8fw\" (UniqueName: \"kubernetes.io/projected/65f787ca-b616-467a-9bba-c22e3af4259a-kube-api-access-nm8fw\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:31.975414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975363    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69e4102-eb96-48ef-a774-3e0e20c555e0-konnectivity-ca\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975417    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkzqg\" (UniqueName: \"kubernetes.io/projected/08653b5c-816e-4f13-a951-7e58a7541e80-kube-api-access-zkzqg\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975461    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-bin\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975489    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-config\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975531    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/557e09c2-7c01-4247-89c2-107680229bf9-hosts-file\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975575    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65f787ca-b616-467a-9bba-c22e3af4259a-iptables-alerter-script\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975606    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-modprobe-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.975654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975640    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-systemd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975686    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-ovn\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975718    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-netd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975745    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-script-lib\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975769    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysconfig\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975792    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-kubernetes\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975813    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.975968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975835    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-conf\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.976252 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.975858    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.976252 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.976233    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-registration-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.976375 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.976288    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-systemd-units\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.976375 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.976320    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-var-lib-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.976926    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:31.977069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.976969    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-systemd\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977005    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-run\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977035    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-var-lib-kubelet\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977077    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-log-socket\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977140    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjjj\" (UniqueName: \"kubernetes.io/projected/1879625a-c0e3-45ef-a577-3261d2afd611-kube-api-access-5jjjj\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977173    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-lib-modules\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977204    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-tuned\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977228    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-socket-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977304    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-kubelet\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977341    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/557e09c2-7c01-4247-89c2-107680229bf9-tmp-dir\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:31.977385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977370    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-sys\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977416    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-host\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977450    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977475    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-slash\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977504    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977543    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-env-overrides\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977573    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtkf\" (UniqueName: \"kubernetes.io/projected/53b0eb66-6444-4922-ada3-55376f15e9d3-kube-api-access-2xtkf\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:31.977717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:31.977609    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69e4102-eb96-48ef-a774-3e0e20c555e0-agent-certs\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.011463 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.011439    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 13:37:31 +0000 UTC" deadline="2027-12-14 13:22:33.420614575 +0000 UTC"
May 29 13:42:32.011463 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.011461    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13535h40m1.409155639s"
May 29 13:42:32.063118 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.063095    2549 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 13:42:32.077884 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077855    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077892    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-registration-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077915    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-systemd-units\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077940    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077963    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-systemd\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077973    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.077986    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-run\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078322 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078117    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-systemd-units\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.078322 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078131    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-systemd\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078322 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.078229    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:32.078322 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078281    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-run\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078322 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078310    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-var-lib-kubelet\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078335    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-netns\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078364    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjjj\" (UniqueName: \"kubernetes.io/projected/1879625a-c0e3-45ef-a577-3261d2afd611-kube-api-access-5jjjj\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078388    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-serviceca\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078409    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-var-lib-kubelet\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078411    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-system-cni-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.078441    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:32.578414929 +0000 UTC m=+3.060659396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078471    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-registration-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078552 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078486    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078556    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078595    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-socket-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078646    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/557e09c2-7c01-4247-89c2-107680229bf9-tmp-dir\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078662    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-sys\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078711    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-host\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078729    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078760    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-socket-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078770    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078784    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-host\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078794    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-env-overrides\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.078927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078916    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtkf\" (UniqueName: \"kubernetes.io/projected/53b0eb66-6444-4922-ada3-55376f15e9d3-kube-api-access-2xtkf\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078954    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69e4102-eb96-48ef-a774-3e0e20c555e0-agent-certs\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078975    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/557e09c2-7c01-4247-89c2-107680229bf9-tmp-dir\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078920    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-sys\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.078979    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-tmp\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079067    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-bin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079095    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-multus-certs\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079131    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-device-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079154    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-sys-fs\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079177    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079203    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-device-dir\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079204    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079239    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079274    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-env-overrides\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079252    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079292    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tm4vh\" (UniqueName: \"kubernetes.io/projected/557e09c2-7c01-4247-89c2-107680229bf9-kube-api-access-tm4vh\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079284    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 13:42:32.079445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079324    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-sys-fs\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079334    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-system-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079373    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-os-release\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079406    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-socket-dir-parent\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079437    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-node-log\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079478    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm8fw\" (UniqueName: \"kubernetes.io/projected/65f787ca-b616-467a-9bba-c22e3af4259a-kube-api-access-nm8fw\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079502    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-node-log\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079542    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-k8s-cni-cncf-io\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079568    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-etc-kubernetes\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079673    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079703    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-bin\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079730    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-config\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079754    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/557e09c2-7c01-4247-89c2-107680229bf9-hosts-file\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079763    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-bin\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079781    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysconfig\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079809    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079834    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-conf\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080211 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079844    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysconfig\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079858    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-script-lib\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079883    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/557e09c2-7c01-4247-89c2-107680229bf9-hosts-file\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079909    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079912    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.079980    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-sysctl-conf\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080008    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-daemon-config\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080032    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-var-lib-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080051    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-conf-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080081    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xvwl\" (UniqueName: \"kubernetes.io/projected/c23ab90e-66ad-44d8-ac19-b71a61648930-kube-api-access-4xvwl\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080090    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-var-lib-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080111    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-log-socket\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080140    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-lib-modules\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080146    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-log-socket\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080161    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-config\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080183    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-tuned\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080213    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-host\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.080967 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080238    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-multus\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080281    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-lib-modules\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080280    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-kubelet\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080317    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-kubelet\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080342    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-hostroot\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080365    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-cnibin\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080405    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-kubelet\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080393    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080452    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-slash\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080480    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-os-release\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080507    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-slash\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080561    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqq6\" (UniqueName: \"kubernetes.io/projected/d4b8ca7c-2356-48d5-865d-36dd576a7e11-kube-api-access-wbqq6\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080591    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080396    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b0eb66-6444-4922-ada3-55376f15e9d3-ovnkube-script-lib\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080706    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-netns\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080700    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/08653b5c-816e-4f13-a951-7e58a7541e80-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.081782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080735    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-etc-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080773    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b0eb66-6444-4922-ada3-55376f15e9d3-ovn-node-metrics-cert\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080773    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-run-netns\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080810    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-etc-openvswitch\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080838    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f787ca-b616-467a-9bba-c22e3af4259a-host-slash\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080862    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69e4102-eb96-48ef-a774-3e0e20c555e0-konnectivity-ca\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080889    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-cnibin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080889    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f787ca-b616-467a-9bba-c22e3af4259a-host-slash\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080923    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkzqg\" (UniqueName: \"kubernetes.io/projected/08653b5c-816e-4f13-a951-7e58a7541e80-kube-api-access-zkzqg\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080950    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65f787ca-b616-467a-9bba-c22e3af4259a-iptables-alerter-script\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.080974    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-modprobe-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081003    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7s2\" (UniqueName: \"kubernetes.io/projected/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-kube-api-access-sw7s2\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081028    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-cni-binary-copy\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081072    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrcp\" (UniqueName: \"kubernetes.io/projected/11ab91de-aef3-4293-bfd0-74bf04f873d3-kube-api-access-hqrcp\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081099    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-systemd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081126    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-ovn\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081151    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-netd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.082565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081165    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-systemd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081176    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-kubernetes\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081251    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-run-ovn\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081278    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-modprobe-d\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081333    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-kubernetes\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081339    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b0eb66-6444-4922-ada3-55376f15e9d3-host-cni-netd\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.081402    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e69e4102-eb96-48ef-a774-3e0e20c555e0-konnectivity-ca\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.082423    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65f787ca-b616-467a-9bba-c22e3af4259a-iptables-alerter-script\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.082962    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-tmp\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.083326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.083327    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e69e4102-eb96-48ef-a774-3e0e20c555e0-agent-certs\") pod \"konnectivity-agent-bcrfd\" (UID: \"e69e4102-eb96-48ef-a774-3e0e20c555e0\") " pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.083681 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.083513    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4b8ca7c-2356-48d5-865d-36dd576a7e11-etc-tuned\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.083807 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.083789    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b0eb66-6444-4922-ada3-55376f15e9d3-ovn-node-metrics-cert\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.086756 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.086732    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:32.086756 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.086767    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:32.086756 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.086779    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:32.086756 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.086832    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:42:32.586817056 +0000 UTC m=+3.069061528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:32.086756 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.086946    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjjj\" (UniqueName: \"kubernetes.io/projected/1879625a-c0e3-45ef-a577-3261d2afd611-kube-api-access-5jjjj\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:32.088941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.088914    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm8fw\" (UniqueName: \"kubernetes.io/projected/65f787ca-b616-467a-9bba-c22e3af4259a-kube-api-access-nm8fw\") pod \"iptables-alerter-t5dww\" (UID: \"65f787ca-b616-467a-9bba-c22e3af4259a\") " pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.089101 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.089068    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm4vh\" (UniqueName: \"kubernetes.io/projected/557e09c2-7c01-4247-89c2-107680229bf9-kube-api-access-tm4vh\") pod \"node-resolver-w9b22\" (UID: \"557e09c2-7c01-4247-89c2-107680229bf9\") " pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.089652 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.089630    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkzqg\" (UniqueName: \"kubernetes.io/projected/08653b5c-816e-4f13-a951-7e58a7541e80-kube-api-access-zkzqg\") pod \"aws-ebs-csi-driver-node-dtwnf\" (UID: \"08653b5c-816e-4f13-a951-7e58a7541e80\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.089735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.089652    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqq6\" (UniqueName: \"kubernetes.io/projected/d4b8ca7c-2356-48d5-865d-36dd576a7e11-kube-api-access-wbqq6\") pod \"tuned-z9nbv\" (UID: \"d4b8ca7c-2356-48d5-865d-36dd576a7e11\") " pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.090208 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.090181    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtkf\" (UniqueName: \"kubernetes.io/projected/53b0eb66-6444-4922-ada3-55376f15e9d3-kube-api-access-2xtkf\") pod \"ovnkube-node-bthnm\" (UID: \"53b0eb66-6444-4922-ada3-55376f15e9d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.181712 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181684    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-conf-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181712 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181715    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xvwl\" (UniqueName: \"kubernetes.io/projected/c23ab90e-66ad-44d8-ac19-b71a61648930-kube-api-access-4xvwl\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181733    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-host\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181751    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-multus\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181775    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-kubelet\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181801    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-hostroot\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181809    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-conf-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181817    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-host\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181829    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-multus\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181850    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-kubelet\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181861    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-hostroot\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181826    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-cnibin\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.181885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181872    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-cnibin\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181906    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-os-release\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181924    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181944    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-cnibin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181964    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7s2\" (UniqueName: \"kubernetes.io/projected/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-kube-api-access-sw7s2\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181979    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-cni-binary-copy\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181992    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-os-release\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.181994    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrcp\" (UniqueName: \"kubernetes.io/projected/11ab91de-aef3-4293-bfd0-74bf04f873d3-kube-api-access-hqrcp\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182090    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-netns\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182116    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-serviceca\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182142    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-system-cni-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182167    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182192    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182226    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-bin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182250    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-multus-certs\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182275 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182250    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-cnibin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182313    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-multus-certs\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182311    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-system-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182352    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-os-release\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182356    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-system-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182387    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-socket-dir-parent\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182407    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-os-release\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182417    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-k8s-cni-cncf-io\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182443    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-etc-kubernetes\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182470    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182479    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182484    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-system-cni-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182494    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-cni-binary-copy\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182503    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182535    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-daemon-config\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182545    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-var-lib-cni-bin\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182445    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-netns\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182596    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11ab91de-aef3-4293-bfd0-74bf04f873d3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.182793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182682    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-cni-dir\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182918    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182931    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-serviceca\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.182977    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-host-run-k8s-cni-cncf-io\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.183025    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-etc-kubernetes\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.183077    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-socket-dir-parent\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.183087    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c23ab90e-66ad-44d8-ac19-b71a61648930-multus-daemon-config\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.183452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.183295    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11ab91de-aef3-4293-bfd0-74bf04f873d3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.190643 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.190619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xvwl\" (UniqueName: \"kubernetes.io/projected/c23ab90e-66ad-44d8-ac19-b71a61648930-kube-api-access-4xvwl\") pod \"multus-n8dlm\" (UID: \"c23ab90e-66ad-44d8-ac19-b71a61648930\") " pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.191479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.191457    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrcp\" (UniqueName: \"kubernetes.io/projected/11ab91de-aef3-4293-bfd0-74bf04f873d3-kube-api-access-hqrcp\") pod \"multus-additional-cni-plugins-7nvs5\" (UID: \"11ab91de-aef3-4293-bfd0-74bf04f873d3\") " pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.191884 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.191864    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7s2\" (UniqueName: \"kubernetes.io/projected/aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3-kube-api-access-sw7s2\") pod \"node-ca-kp9zf\" (UID: \"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3\") " pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.265477 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.265405    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w9b22"
May 29 13:42:32.275118 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.275098    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t5dww"
May 29 13:42:32.283498 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.283473    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:32.291118 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.291098    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:32.297697 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.297676    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9nbv"
May 29 13:42:32.306227 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.306210    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf"
May 29 13:42:32.311774 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.311750    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kp9zf"
May 29 13:42:32.319402 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.319385    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nvs5"
May 29 13:42:32.324942 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.324922    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8dlm"
May 29 13:42:32.585690 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.585660    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:32.585870 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.585789    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:32.585870 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.585862    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:33.585841822 +0000 UTC m=+4.068086294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:32.666019 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.665993    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08653b5c_816e_4f13_a951_7e58a7541e80.slice/crio-3aadb23dcb46bec95765369a9acfdc7293c16df2c649d920765f79e3ba20050d WatchSource:0}: Error finding container 3aadb23dcb46bec95765369a9acfdc7293c16df2c649d920765f79e3ba20050d: Status 404 returned error can't find the container with id 3aadb23dcb46bec95765369a9acfdc7293c16df2c649d920765f79e3ba20050d
May 29 13:42:32.667108 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.667078    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f787ca_b616_467a_9bba_c22e3af4259a.slice/crio-d12f774a0e3e456b78ac07f1ac8b4faf301ee44aad18a323b6ac1afc3746a962 WatchSource:0}: Error finding container d12f774a0e3e456b78ac07f1ac8b4faf301ee44aad18a323b6ac1afc3746a962: Status 404 returned error can't find the container with id d12f774a0e3e456b78ac07f1ac8b4faf301ee44aad18a323b6ac1afc3746a962
May 29 13:42:32.667903 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.667879    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ab91de_aef3_4293_bfd0_74bf04f873d3.slice/crio-cb61cb2bbde816e8326276ef7dc7877e53fbd49c402a46c20163b3e52753e692 WatchSource:0}: Error finding container cb61cb2bbde816e8326276ef7dc7877e53fbd49c402a46c20163b3e52753e692: Status 404 returned error can't find the container with id cb61cb2bbde816e8326276ef7dc7877e53fbd49c402a46c20163b3e52753e692
May 29 13:42:32.668790 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.668773    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b0eb66_6444_4922_ada3_55376f15e9d3.slice/crio-bae76b851da443f5368de1e69450d73e15a0995d2e78b3fdc65c3b5961d15ec0 WatchSource:0}: Error finding container bae76b851da443f5368de1e69450d73e15a0995d2e78b3fdc65c3b5961d15ec0: Status 404 returned error can't find the container with id bae76b851da443f5368de1e69450d73e15a0995d2e78b3fdc65c3b5961d15ec0
May 29 13:42:32.670923 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.670757    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557e09c2_7c01_4247_89c2_107680229bf9.slice/crio-714906a8c6d9a5c37ebf37eca15e6000a5c891360d099f4d23d3800abd4bd5fc WatchSource:0}: Error finding container 714906a8c6d9a5c37ebf37eca15e6000a5c891360d099f4d23d3800abd4bd5fc: Status 404 returned error can't find the container with id 714906a8c6d9a5c37ebf37eca15e6000a5c891360d099f4d23d3800abd4bd5fc
May 29 13:42:32.673355 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.673333    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeaebd06_5f72_40d5_a4b0_2fd5ff211ea3.slice/crio-5a1dad4562cb77a6a6528e2f252426b217137cce02bc95afe2b09cafa4dd22df WatchSource:0}: Error finding container 5a1dad4562cb77a6a6528e2f252426b217137cce02bc95afe2b09cafa4dd22df: Status 404 returned error can't find the container with id 5a1dad4562cb77a6a6528e2f252426b217137cce02bc95afe2b09cafa4dd22df
May 29 13:42:32.675160 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.675117    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69e4102_eb96_48ef_a774_3e0e20c555e0.slice/crio-50b4c5cff5e6f94d8e28e53f186b2d7c16518c2be774d84ac3cd9bb1851d01bf WatchSource:0}: Error finding container 50b4c5cff5e6f94d8e28e53f186b2d7c16518c2be774d84ac3cd9bb1851d01bf: Status 404 returned error can't find the container with id 50b4c5cff5e6f94d8e28e53f186b2d7c16518c2be774d84ac3cd9bb1851d01bf
May 29 13:42:32.676973 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.675754    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b8ca7c_2356_48d5_865d_36dd576a7e11.slice/crio-1a4504996030801267ce50facbad00f67af74eeaea2defa9133daf98cfdd6d72 WatchSource:0}: Error finding container 1a4504996030801267ce50facbad00f67af74eeaea2defa9133daf98cfdd6d72: Status 404 returned error can't find the container with id 1a4504996030801267ce50facbad00f67af74eeaea2defa9133daf98cfdd6d72
May 29 13:42:32.677688 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:42:32.677607    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23ab90e_66ad_44d8_ac19_b71a61648930.slice/crio-572aaec944d2d72aa32bbd724a4dc5c54d8ba012fee4cf184114fc3cc1a490ec WatchSource:0}: Error finding container 572aaec944d2d72aa32bbd724a4dc5c54d8ba012fee4cf184114fc3cc1a490ec: Status 404 returned error can't find the container with id 572aaec944d2d72aa32bbd724a4dc5c54d8ba012fee4cf184114fc3cc1a490ec
May 29 13:42:32.686780 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:32.686756    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:32.686920 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.686900    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:32.686920 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.686920    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:32.687054 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.686930    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:32.687054 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:32.686971    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:42:33.686958084 +0000 UTC m=+4.169202539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:33.012165 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.012004    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 13:37:31 +0000 UTC" deadline="2027-11-10 16:21:35.26154764 +0000 UTC"
May 29 13:42:33.012165 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.012163    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12722h39m2.249388853s"
May 29 13:42:33.102983 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.102486    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:33.102983 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.102608    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:33.116205 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.116151    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"bae76b851da443f5368de1e69450d73e15a0995d2e78b3fdc65c3b5961d15ec0"}
May 29 13:42:33.123059 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.122988    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerStarted","Data":"cb61cb2bbde816e8326276ef7dc7877e53fbd49c402a46c20163b3e52753e692"}
May 29 13:42:33.134829 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.134802    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5dww" event={"ID":"65f787ca-b616-467a-9bba-c22e3af4259a","Type":"ContainerStarted","Data":"d12f774a0e3e456b78ac07f1ac8b4faf301ee44aad18a323b6ac1afc3746a962"}
May 29 13:42:33.137246 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.137220    2549 generic.go:358] "Generic (PLEG): container finished" podID="04184eb0664bd9f33475028c5e88f897" containerID="4279329a3bfa5d24252d084cc6fa4f6d257412c4b6d9529150815688356ded0d" exitCode=0
May 29 13:42:33.137382 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.137311    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal" event={"ID":"04184eb0664bd9f33475028c5e88f897","Type":"ContainerDied","Data":"4279329a3bfa5d24252d084cc6fa4f6d257412c4b6d9529150815688356ded0d"}
May 29 13:42:33.149434 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.149083    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9nbv" event={"ID":"d4b8ca7c-2356-48d5-865d-36dd576a7e11","Type":"ContainerStarted","Data":"1a4504996030801267ce50facbad00f67af74eeaea2defa9133daf98cfdd6d72"}
May 29 13:42:33.150688 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.150656    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kp9zf" event={"ID":"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3","Type":"ContainerStarted","Data":"5a1dad4562cb77a6a6528e2f252426b217137cce02bc95afe2b09cafa4dd22df"}
May 29 13:42:33.153053 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.153001    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf" event={"ID":"08653b5c-816e-4f13-a951-7e58a7541e80","Type":"ContainerStarted","Data":"3aadb23dcb46bec95765369a9acfdc7293c16df2c649d920765f79e3ba20050d"}
May 29 13:42:33.167667 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.167642    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal" event={"ID":"b9dce095611a9775221d01535f4957b7","Type":"ContainerStarted","Data":"163620fb38de25b7fda9f3a1d9baa66f87ca0468f61c78a1bf0c9cd9bde3e5b5"}
May 29 13:42:33.172638 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.172615    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8dlm" event={"ID":"c23ab90e-66ad-44d8-ac19-b71a61648930","Type":"ContainerStarted","Data":"572aaec944d2d72aa32bbd724a4dc5c54d8ba012fee4cf184114fc3cc1a490ec"}
May 29 13:42:33.177091 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.177071    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcrfd" event={"ID":"e69e4102-eb96-48ef-a774-3e0e20c555e0","Type":"ContainerStarted","Data":"50b4c5cff5e6f94d8e28e53f186b2d7c16518c2be774d84ac3cd9bb1851d01bf"}
May 29 13:42:33.179377 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.179345    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9b22" event={"ID":"557e09c2-7c01-4247-89c2-107680229bf9","Type":"ContainerStarted","Data":"714906a8c6d9a5c37ebf37eca15e6000a5c891360d099f4d23d3800abd4bd5fc"}
May 29 13:42:33.605220 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.605179    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:33.605410 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.605360    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:33.605478 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.605427    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:35.605407376 +0000 UTC m=+6.087651845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:33.706307 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:33.706213    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:33.706459 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.706423    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:33.706459 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.706444    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:33.706459 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.706458    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:33.706613 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:33.706521    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:42:35.706500257 +0000 UTC m=+6.188744715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:34.103276 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:34.102686    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:34.103276 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:34.102835    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:34.189444 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:34.189319    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal" event={"ID":"04184eb0664bd9f33475028c5e88f897","Type":"ContainerStarted","Data":"92e79eb0c127c238545577c551436462e3eac374ef69469fd5ac69462c53be42"}
May 29 13:42:34.206943 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:34.206009    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-221.ec2.internal" podStartSLOduration=3.205992268 podStartE2EDuration="3.205992268s" podCreationTimestamp="2026-05-29 13:42:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:42:33.183838049 +0000 UTC m=+3.666082527" watchObservedRunningTime="2026-05-29 13:42:34.205992268 +0000 UTC m=+4.688236748"
May 29 13:42:35.102407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:35.101922    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:35.102407 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.102040    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:35.625505 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:35.625468    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:35.626008 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.625618    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:35.626008 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.625676    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:39.625657542 +0000 UTC m=+10.107902002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:35.726045 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:35.726008    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:35.726216 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.726176    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:35.726216 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.726201    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:35.726216 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.726214    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:35.726454 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:35.726287    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:42:39.726253569 +0000 UTC m=+10.208498028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:36.105071 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:36.104599    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:36.105071 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:36.104733    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:37.102356 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:37.102297    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:37.102812 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:37.102434    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:38.102339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:38.102303    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:38.102525 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:38.102448    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:39.102413 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:39.102380    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:39.102594 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.102501    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:39.658663 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:39.658612    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:39.658852 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.658796    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:39.658917 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.658865    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:42:47.65884404 +0000 UTC m=+18.141088506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:39.760018 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:39.759982    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:39.760186 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.760130    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:39.760186 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.760149    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:39.760186 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.760162    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:39.760368 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:39.760220    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:42:47.760201229 +0000 UTC m=+18.242445700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:40.103571 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:40.103081    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:40.103571 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:40.103202    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:41.102926 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:41.102531    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:41.102926 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:41.102652    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:42.102314 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:42.102283    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:42.102740 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:42.102395    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:43.102145 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:43.102110    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:43.102339 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:43.102222    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:44.102518 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:44.102472    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:44.102967 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:44.102607    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:45.101864 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:45.101835    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:45.102024 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:45.101932    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:46.102565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:46.102536    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:46.103000 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:46.102655    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:47.101951 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:47.101914    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:47.102103 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.102036    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:47.721585 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:47.721553    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:47.722028 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.721675    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:47.722028 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.721728    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:03.721712602 +0000 UTC m=+34.203957058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:42:47.821876 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:47.821842    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:47.822050 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.821997    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:42:47.822050 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.822024    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:42:47.822050 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.822035    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:47.822201 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:47.822088    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:43:03.822070468 +0000 UTC m=+34.304314944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:42:48.102017 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:48.101983    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:48.102190 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:48.102119    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:49.102531 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:49.102491    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:49.102960 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:49.102623    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:50.102817 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:50.102788    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:50.103158 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:50.102875    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:51.102664 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.102246    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:51.102803 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:51.102778    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:51.220335 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.220298    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9nbv" event={"ID":"d4b8ca7c-2356-48d5-865d-36dd576a7e11","Type":"ContainerStarted","Data":"802762565a42e8671e8c859a9294e87e459c6c789a8e1ad027d1127146ad764c"}
May 29 13:42:51.221899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.221869    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kp9zf" event={"ID":"aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3","Type":"ContainerStarted","Data":"b18595a7c201beb58ad368584c052f99b6052abc631b524382fd03a38c764ae8"}
May 29 13:42:51.223403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.223378    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf" event={"ID":"08653b5c-816e-4f13-a951-7e58a7541e80","Type":"ContainerStarted","Data":"a5f485b14369f3192dbe8490fb82593c7158e308f92211fe83bb5633ed268431"}
May 29 13:42:51.224651 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.224629    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8dlm" event={"ID":"c23ab90e-66ad-44d8-ac19-b71a61648930","Type":"ContainerStarted","Data":"7c223c89bc5ab4a67c69cdcf06a2316f5ef583f3974575418d01f46831b01090"}
May 29 13:42:51.225964 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.225943    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bcrfd" event={"ID":"e69e4102-eb96-48ef-a774-3e0e20c555e0","Type":"ContainerStarted","Data":"beccd8c02bbc8881327f273d59d350fb533adc9a603f33e1fab1e95e320af411"}
May 29 13:42:51.227432 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.227410    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w9b22" event={"ID":"557e09c2-7c01-4247-89c2-107680229bf9","Type":"ContainerStarted","Data":"e64f0a06cd8b773bd9748f8254b70d3fa87d4825088e48971d4595820841adfa"}
May 29 13:42:51.230004 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.229986    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:42:51.230324 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230303    2549 generic.go:358] "Generic (PLEG): container finished" podID="53b0eb66-6444-4922-ada3-55376f15e9d3" containerID="7d085543de4cc2d4480d465d1b5e2905896a17193e4b7a1dfb1819c44674f232" exitCode=1
May 29 13:42:51.230403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230358    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"588a7d5404de18d15664b4ea04dec6cdb834f1c9babdb73ba376a80d7c90048c"}
May 29 13:42:51.230403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230385    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"b1729fefaaf20fdf189cef7aec69bc16aafc5e98b382bbb34abec3dedc6ceaaf"}
May 29 13:42:51.230502 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230409    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"e07a29e4db1fd2216b817d362f7fc6a8963829b9903e163f2c77d2e6144a04a8"}
May 29 13:42:51.230502 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230422    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"b873485e0a4f9d8a2c9a275e9979b6e535241edcdae117d64555d8c4c799ddca"}
May 29 13:42:51.230502 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230436    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerDied","Data":"7d085543de4cc2d4480d465d1b5e2905896a17193e4b7a1dfb1819c44674f232"}
May 29 13:42:51.230502 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.230450    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"a32c5dfc50a32783816a75cf18a2e929e50131c160e4905d21316add83f0e354"}
May 29 13:42:51.231810 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.231791    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="adbb4041dcf4ad5fd2679e8d009b370d8d86ca1a95067cba61da390272c9eaf7" exitCode=0
May 29 13:42:51.231893 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.231820    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"adbb4041dcf4ad5fd2679e8d009b370d8d86ca1a95067cba61da390272c9eaf7"}
May 29 13:42:51.239142 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.239107    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-221.ec2.internal" podStartSLOduration=20.239095531 podStartE2EDuration="20.239095531s" podCreationTimestamp="2026-05-29 13:42:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:42:34.206866212 +0000 UTC m=+4.689110692" watchObservedRunningTime="2026-05-29 13:42:51.239095531 +0000 UTC m=+21.721340008"
May 29 13:42:51.264662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.264612    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z9nbv" podStartSLOduration=3.5639188280000003 podStartE2EDuration="21.264597183s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.676991983 +0000 UTC m=+3.159236439" lastFinishedPulling="2026-05-29 13:42:50.377670339 +0000 UTC m=+20.859914794" observedRunningTime="2026-05-29 13:42:51.239174155 +0000 UTC m=+21.721418634" watchObservedRunningTime="2026-05-29 13:42:51.264597183 +0000 UTC m=+21.746841660"
May 29 13:42:51.282094 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.282055    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n8dlm" podStartSLOduration=3.544460178 podStartE2EDuration="21.282041999s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.678742994 +0000 UTC m=+3.160987451" lastFinishedPulling="2026-05-29 13:42:50.416324807 +0000 UTC m=+20.898569272" observedRunningTime="2026-05-29 13:42:51.281669441 +0000 UTC m=+21.763913919" watchObservedRunningTime="2026-05-29 13:42:51.282041999 +0000 UTC m=+21.764286476"
May 29 13:42:51.297080 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.297027    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bcrfd" podStartSLOduration=3.597666576 podStartE2EDuration="21.297012246s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.676691747 +0000 UTC m=+3.158936211" lastFinishedPulling="2026-05-29 13:42:50.376037409 +0000 UTC m=+20.858281881" observedRunningTime="2026-05-29 13:42:51.296169506 +0000 UTC m=+21.778413982" watchObservedRunningTime="2026-05-29 13:42:51.297012246 +0000 UTC m=+21.779256724"
May 29 13:42:51.310781 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.310748    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kp9zf" podStartSLOduration=11.544805966 podStartE2EDuration="21.310737498s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.676780967 +0000 UTC m=+3.159025422" lastFinishedPulling="2026-05-29 13:42:42.442712484 +0000 UTC m=+12.924956954" observedRunningTime="2026-05-29 13:42:51.310401762 +0000 UTC m=+21.792646241" watchObservedRunningTime="2026-05-29 13:42:51.310737498 +0000 UTC m=+21.792981974"
May 29 13:42:51.325832 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.325800    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-w9b22" podStartSLOduration=3.625026711 podStartE2EDuration="21.325786395s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.675348527 +0000 UTC m=+3.157592983" lastFinishedPulling="2026-05-29 13:42:50.376108199 +0000 UTC m=+20.858352667" observedRunningTime="2026-05-29 13:42:51.325239421 +0000 UTC m=+21.807483899" watchObservedRunningTime="2026-05-29 13:42:51.325786395 +0000 UTC m=+21.808030874"
May 29 13:42:51.743958 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:51.743931    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 13:42:52.030394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.030306    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T13:42:51.743953544Z","UUID":"12220a9f-aa8f-4c60-b303-cc86c5f43e07","Handler":null,"Name":"","Endpoint":""}
May 29 13:42:52.031997 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.031978    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 13:42:52.032129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.032008    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 13:42:52.102215 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.102193    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:52.102360 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:52.102314    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:52.234927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.234890    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t5dww" event={"ID":"65f787ca-b616-467a-9bba-c22e3af4259a","Type":"ContainerStarted","Data":"f887f8a544e8af95140dcadedb990cf96a18377ad712a5feda7feb7ee7198763"}
May 29 13:42:52.237345 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.237299    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf" event={"ID":"08653b5c-816e-4f13-a951-7e58a7541e80","Type":"ContainerStarted","Data":"2990b83d8deec0fc73fb7f41cbd9a07f3fe5c3c17485cf8556067e6edeb145e6"}
May 29 13:42:52.250676 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:52.250638    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t5dww" podStartSLOduration=4.543591504 podStartE2EDuration="22.250628457s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.668946266 +0000 UTC m=+3.151190734" lastFinishedPulling="2026-05-29 13:42:50.37598322 +0000 UTC m=+20.858227687" observedRunningTime="2026-05-29 13:42:52.250445509 +0000 UTC m=+22.732696045" watchObservedRunningTime="2026-05-29 13:42:52.250628457 +0000 UTC m=+22.732872934"
May 29 13:42:53.102632 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:53.102567    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:53.102758 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:53.102649    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:53.240733 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:53.240697    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf" event={"ID":"08653b5c-816e-4f13-a951-7e58a7541e80","Type":"ContainerStarted","Data":"c3f97fc3c306fc07c18bc4552db9408a9fe0b699f8c7ab5a687cf0881f9c6d3d"}
May 29 13:42:53.261063 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:53.261026    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtwnf" podStartSLOduration=3.152045981 podStartE2EDuration="23.261011365s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.667716507 +0000 UTC m=+3.149960963" lastFinishedPulling="2026-05-29 13:42:52.776681875 +0000 UTC m=+23.258926347" observedRunningTime="2026-05-29 13:42:53.260783155 +0000 UTC m=+23.743027632" watchObservedRunningTime="2026-05-29 13:42:53.261011365 +0000 UTC m=+23.743255841"
May 29 13:42:54.102137 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:54.101930    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:54.102291 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:54.102247    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:54.245489 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:54.245463    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:42:54.245986 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:54.245827    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"ab23549ade21113f996a30282e691cae2376c5cc7c3104f53544d6b0998d12c2"}
May 29 13:42:54.387778 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:54.387711    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:54.388391 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:54.388365    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:55.102312 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:55.102282    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:55.102493 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:55.102407    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:55.247661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:55.247633    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:55.248165 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:55.248143    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bcrfd"
May 29 13:42:56.102380 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.102126    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:56.102522 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:56.102497    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:56.251190 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.251168    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:42:56.251940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.251497    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"eec806200af307edb828da3ff6af01a0b23428e82c5f43bff8d5696f53471054"}
May 29 13:42:56.251940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.251795    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:56.251940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.251819    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:56.252093 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.252018    2549 scope.go:117] "RemoveContainer" containerID="7d085543de4cc2d4480d465d1b5e2905896a17193e4b7a1dfb1819c44674f232"
May 29 13:42:56.253187 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.253164    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="003b1d17a52d70b56ffc09523d1ba6b889900719f328004986eb3f7e8ec40117" exitCode=0
May 29 13:42:56.253315 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.253250    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"003b1d17a52d70b56ffc09523d1ba6b889900719f328004986eb3f7e8ec40117"}
May 29 13:42:56.267162 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:56.267142    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:57.102196 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.102171    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:57.102339 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:57.102282    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:57.258719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.258647    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:42:57.259090 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.258997    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" event={"ID":"53b0eb66-6444-4922-ada3-55376f15e9d3","Type":"ContainerStarted","Data":"daff4da9a5a0693e0beb1b4645288d341ccb8eb25d11cc7a279a77439a482023"}
May 29 13:42:57.259280 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.259243    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:57.261153 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.261123    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="b01be95409f5a00b055cdc0cd35790dee2eada2da8774d89e416f4d92ed50af7" exitCode=0
May 29 13:42:57.261231 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.261172    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"b01be95409f5a00b055cdc0cd35790dee2eada2da8774d89e416f4d92ed50af7"}
May 29 13:42:57.274559 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.274539    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:42:57.289564 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.289526    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm" podStartSLOduration=9.559191578 podStartE2EDuration="27.289512877s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.671896338 +0000 UTC m=+3.154140793" lastFinishedPulling="2026-05-29 13:42:50.402217629 +0000 UTC m=+20.884462092" observedRunningTime="2026-05-29 13:42:57.288890579 +0000 UTC m=+27.771135068" watchObservedRunningTime="2026-05-29 13:42:57.289512877 +0000 UTC m=+27.771757354"
May 29 13:42:57.636117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.636075    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-878zh"]
May 29 13:42:57.638855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.636431    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:57.638855 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:57.636584    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:57.638855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.637722    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dspt"]
May 29 13:42:57.638855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:57.637860    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:57.638855 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:57.637996    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:42:58.265155 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:58.265081    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="bd7552abb529a8d67114b3036fdf6ef74dd925af7335de7c945f3e1e965c27e6" exitCode=0
May 29 13:42:58.265564 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:58.265145    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"bd7552abb529a8d67114b3036fdf6ef74dd925af7335de7c945f3e1e965c27e6"}
May 29 13:42:59.101842 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:59.101808    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:42:59.102042 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:42:59.101814    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:42:59.102042 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:59.101932    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:42:59.102042 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:42:59.102012    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:43:01.101714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:01.101679    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:01.102352 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:01.101681    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:43:01.102352 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:01.101805    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:43:01.102352 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:01.101921    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:43:03.101913 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.101877    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:43:03.102580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.101877    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:03.102580 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.102018    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:43:03.102580 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.102093    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zh" podUID="8535cc85-faba-4239-9831-fd4372c3212e"
May 29 13:43:03.343351 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.343323    2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-221.ec2.internal" event="NodeReady"
May 29 13:43:03.343531 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.343456    2549 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 13:43:03.389523 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.389486    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hrkf"]
May 29 13:43:03.447213 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.447188    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ql579"]
May 29 13:43:03.447385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.447350    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.448003 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.447975    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a195377-00dd-4e32-b515-491c5986e765-tmp-dir\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.448132 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.448010    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zh9z\" (UniqueName: \"kubernetes.io/projected/8a195377-00dd-4e32-b515-491c5986e765-kube-api-access-7zh9z\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.448132 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.448040    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.448254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.448121    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a195377-00dd-4e32-b515-491c5986e765-config-volume\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.450286 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.450244    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 13:43:03.453364 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.450738    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 13:43:03.453364 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.451495    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfdw\""
May 29 13:43:03.459460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.459434    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hrkf"]
May 29 13:43:03.459460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.459461    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ql579"]
May 29 13:43:03.459630 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.459549    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.461977 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.461958    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 13:43:03.462072 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.461985    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 13:43:03.462072 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.461996    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25vw9\""
May 29 13:43:03.462072 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.461985    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 13:43:03.549129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549097    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.549129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549132    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.549369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549175    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a195377-00dd-4e32-b515-491c5986e765-config-volume\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.549369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549240    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4nc\" (UniqueName: \"kubernetes.io/projected/f9d0cd67-e3f9-4d13-867c-e87844047b23-kube-api-access-dq4nc\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.549369 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.549282    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:03.549369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549311    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a195377-00dd-4e32-b515-491c5986e765-tmp-dir\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.549369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549350    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zh9z\" (UniqueName: \"kubernetes.io/projected/8a195377-00dd-4e32-b515-491c5986e765-kube-api-access-7zh9z\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.549620 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.549405    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:04.049384505 +0000 UTC m=+34.531628965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:03.549684 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549632    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a195377-00dd-4e32-b515-491c5986e765-tmp-dir\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.549794 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.549773    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a195377-00dd-4e32-b515-491c5986e765-config-volume\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.560252 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.560232    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zh9z\" (UniqueName: \"kubernetes.io/projected/8a195377-00dd-4e32-b515-491c5986e765-kube-api-access-7zh9z\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:03.649750 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.649674    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.649887 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.649774    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4nc\" (UniqueName: \"kubernetes.io/projected/f9d0cd67-e3f9-4d13-867c-e87844047b23-kube-api-access-dq4nc\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.649887 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.649846    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:03.650003 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.649920    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:04.149900059 +0000 UTC m=+34.632144517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:03.659003 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.658979    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4nc\" (UniqueName: \"kubernetes.io/projected/f9d0cd67-e3f9-4d13-867c-e87844047b23-kube-api-access-dq4nc\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:03.750996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.750963    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:43:03.751143 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.751122    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:43:03.751220 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.751209    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:35.751190339 +0000 UTC m=+66.233434809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 13:43:03.852278 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:03.852235    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:03.852409 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.852394    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 13:43:03.852450 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.852414    2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 13:43:03.852450 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.852425    2549 projected.go:194] Error preparing data for projected volume kube-api-access-gtwfk for pod openshift-network-diagnostics/network-check-target-878zh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:43:03.852510 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:03.852470    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk podName:8535cc85-faba-4239-9831-fd4372c3212e nodeName:}" failed. No retries permitted until 2026-05-29 13:43:35.852455951 +0000 UTC m=+66.334700405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gtwfk" (UniqueName: "kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk") pod "network-check-target-878zh" (UID: "8535cc85-faba-4239-9831-fd4372c3212e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 13:43:04.053623 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:04.053596    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:04.053747 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:04.053729    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:04.053833 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:04.053824    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:05.053808663 +0000 UTC m=+35.536053117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:04.154722 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:04.154705    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:04.155013 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:04.154782    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:04.155013 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:04.154818    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:05.154807151 +0000 UTC m=+35.637051606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:04.279881 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:04.279717    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerStarted","Data":"b924e62ef78349b23084b5485355e89170ecee4885274a077b2d640ca2441240"}
May 29 13:43:05.060609 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.060577    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:05.060776 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:05.060692    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:05.060776 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:05.060748    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:07.060735152 +0000 UTC m=+37.542979607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:05.102337 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.102306    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:05.102461 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.102306    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:43:05.105599 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.105578    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chjd5\""
May 29 13:43:05.105710 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.105597    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 13:43:05.105710 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.105611    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 13:43:05.106472 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.106456    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 13:43:05.106583 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.106567    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km4z9\""
May 29 13:43:05.161846 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.161827    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:05.162195 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:05.161948    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:05.162195 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:05.162000    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:07.161985564 +0000 UTC m=+37.644230019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:05.283754 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.283729    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="b924e62ef78349b23084b5485355e89170ecee4885274a077b2d640ca2441240" exitCode=0
May 29 13:43:05.283852 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:05.283783    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"b924e62ef78349b23084b5485355e89170ecee4885274a077b2d640ca2441240"}
May 29 13:43:06.288626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:06.288595    2549 generic.go:358] "Generic (PLEG): container finished" podID="11ab91de-aef3-4293-bfd0-74bf04f873d3" containerID="8c331b753a3f6deb956e2580c16e0e2499778ad8c1bd632aab77d3871d1058d9" exitCode=0
May 29 13:43:06.288960 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:06.288642    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerDied","Data":"8c331b753a3f6deb956e2580c16e0e2499778ad8c1bd632aab77d3871d1058d9"}
May 29 13:43:07.077556 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:07.077522    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:07.077700 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:07.077668    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:07.077738 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:07.077731    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:11.077715758 +0000 UTC m=+41.559960218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:07.178394 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:07.178369    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:07.178505 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:07.178483    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:07.178550 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:07.178525    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:11.178513152 +0000 UTC m=+41.660757607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:07.292880 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:07.292855    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" event={"ID":"11ab91de-aef3-4293-bfd0-74bf04f873d3","Type":"ContainerStarted","Data":"5d7eb0b931394d5076c398290b90b8807b17e107c65c75fe9608e344d6089066"}
May 29 13:43:07.316564 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:07.316528    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7nvs5" podStartSLOduration=5.859488021 podStartE2EDuration="37.316514536s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:42:32.673370492 +0000 UTC m=+3.155614948" lastFinishedPulling="2026-05-29 13:43:04.130397009 +0000 UTC m=+34.612641463" observedRunningTime="2026-05-29 13:43:07.315208263 +0000 UTC m=+37.797452742" watchObservedRunningTime="2026-05-29 13:43:07.316514536 +0000 UTC m=+37.798759013"
May 29 13:43:11.101105 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:11.101067    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:11.101536 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:11.101183    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:11.101536 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:11.101232    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:19.101218271 +0000 UTC m=+49.583462726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:11.201518 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:11.201493    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:11.201637 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:11.201624    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:11.201682 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:11.201674    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:19.201660471 +0000 UTC m=+49.683904927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:19.152485 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:19.152452    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:19.152907 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:19.152594    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:19.152907 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:19.152685    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:35.152667716 +0000 UTC m=+65.634912183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:19.252862 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:19.252831    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:19.252991 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:19.252965    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:19.253037 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:19.253031    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:43:35.253015165 +0000 UTC m=+65.735259625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:29.277424 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:29.277396    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bthnm"
May 29 13:43:35.155466 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.155428    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:43:35.155864 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.155571    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:43:35.155864 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.155641    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:07.155626737 +0000 UTC m=+97.637871192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:43:35.255910 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.255882    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:43:35.256019 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.255984    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:43:35.256056 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.256032    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:07.256020893 +0000 UTC m=+97.738265348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:43:35.758200 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.758166    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:43:35.761058 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.761039    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 13:43:35.768492 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.768471    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 13:43:35.768563 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:43:35.768541    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:39.768522788 +0000 UTC m=+130.250767247 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : secret "metrics-daemon-secret" not found
May 29 13:43:35.859019 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.858992    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:35.861798 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.861779    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 13:43:35.872299 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.872278    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 13:43:35.883637 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:35.883615    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwfk\" (UniqueName: \"kubernetes.io/projected/8535cc85-faba-4239-9831-fd4372c3212e-kube-api-access-gtwfk\") pod \"network-check-target-878zh\" (UID: \"8535cc85-faba-4239-9831-fd4372c3212e\") " pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:36.015741 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:36.015673    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chjd5\""
May 29 13:43:36.023873 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:36.023852    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:36.178692 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:36.178661    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-878zh"]
May 29 13:43:36.182540 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:43:36.182513    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8535cc85_faba_4239_9831_fd4372c3212e.slice/crio-2a9f5cec1057e86116947a13760d44aad37188e2f84defec04ddf86124378155 WatchSource:0}: Error finding container 2a9f5cec1057e86116947a13760d44aad37188e2f84defec04ddf86124378155: Status 404 returned error can't find the container with id 2a9f5cec1057e86116947a13760d44aad37188e2f84defec04ddf86124378155
May 29 13:43:36.343333 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:36.343303    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-878zh" event={"ID":"8535cc85-faba-4239-9831-fd4372c3212e","Type":"ContainerStarted","Data":"2a9f5cec1057e86116947a13760d44aad37188e2f84defec04ddf86124378155"}
May 29 13:43:39.351116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:39.351083    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-878zh" event={"ID":"8535cc85-faba-4239-9831-fd4372c3212e","Type":"ContainerStarted","Data":"0d842e958118701b120de9eab0db42ed4d7e9cb5d325ebeb259c8754f3ccdacf"}
May 29 13:43:39.351507 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:39.351311    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:43:39.367689 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:43:39.367641    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-878zh" podStartSLOduration=66.700812085 podStartE2EDuration="1m9.367627825s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:43:36.184891036 +0000 UTC m=+66.667135491" lastFinishedPulling="2026-05-29 13:43:38.851706763 +0000 UTC m=+69.333951231" observedRunningTime="2026-05-29 13:43:39.367326316 +0000 UTC m=+69.849570806" watchObservedRunningTime="2026-05-29 13:43:39.367627825 +0000 UTC m=+69.849872303"
May 29 13:44:07.159864 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:07.159755    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:44:07.160310 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:07.159890    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 13:44:07.160310 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:07.159955    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls podName:8a195377-00dd-4e32-b515-491c5986e765 nodeName:}" failed. No retries permitted until 2026-05-29 13:45:11.159941119 +0000 UTC m=+161.642185579 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls") pod "dns-default-6hrkf" (UID: "8a195377-00dd-4e32-b515-491c5986e765") : secret "dns-default-metrics-tls" not found
May 29 13:44:07.260935 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:07.260910    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:44:07.261038 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:07.261019    2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 13:44:07.261078 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:07.261068    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert podName:f9d0cd67-e3f9-4d13-867c-e87844047b23 nodeName:}" failed. No retries permitted until 2026-05-29 13:45:11.261052606 +0000 UTC m=+161.743297062 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert") pod "ingress-canary-ql579" (UID: "f9d0cd67-e3f9-4d13-867c-e87844047b23") : secret "canary-serving-cert" not found
May 29 13:44:10.355572 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:10.355537    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-878zh"
May 29 13:44:21.945495 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.945460    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"]
May 29 13:44:21.950340 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.950319    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"]
May 29 13:44:21.950472 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.950455    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:21.951897 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.951880    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"
May 29 13:44:21.953551 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.953532    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 29 13:44:21.953871 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.953855    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 29 13:44:21.954615 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.954594    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 29 13:44:21.954781 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.954603    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 29 13:44:21.955395 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.955377    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 29 13:44:21.955489 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.955479    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 29 13:44:21.955547 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.955526    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8rssl\""
May 29 13:44:21.955852 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.955833    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"]
May 29 13:44:21.956083 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.956056    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xxw46\""
May 29 13:44:21.957794 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.957781    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"]
May 29 13:44:21.957941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.957924    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:21.959626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.959609    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:21.960314 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.960285    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 29 13:44:21.960522 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.960509    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rzw26\""
May 29 13:44:21.960569 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.960535    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 13:44:21.961557 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.961536    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 13:44:21.961638 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.961547    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 29 13:44:21.962000 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.961986    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j4k7w\""
May 29 13:44:21.962076 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.962050    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 29 13:44:21.962440 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.962424    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 29 13:44:21.963715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.963696    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 29 13:44:21.968237 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.967981    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 29 13:44:21.968527 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.968508    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"]
May 29 13:44:21.969446 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.969421    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"]
May 29 13:44:21.978600 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.978579    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"]
May 29 13:44:21.979141 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:21.979122    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"]
May 29 13:44:22.053714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.053690    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:44:22.055480 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055466    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.055594 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055567    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88645056-d01c-4f0d-8b42-0e911ee1d7b6-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.055691 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055617    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzzxc\" (UniqueName: \"kubernetes.io/projected/5362786f-0b9b-4f04-8121-1939048ab401-kube-api-access-vzzxc\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.055691 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055648    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xd4\" (UniqueName: \"kubernetes.io/projected/e5acb689-7c6d-4e66-8316-cc55ac46bb6a-kube-api-access-n7xd4\") pod \"volume-data-source-validator-5cf8c89d64-h6zhf\" (UID: \"e5acb689-7c6d-4e66-8316-cc55ac46bb6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"
May 29 13:44:22.055691 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055684    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.055828 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055726    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-config\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.055828 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055813    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5362786f-0b9b-4f04-8121-1939048ab401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.055893 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055849    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5362786f-0b9b-4f04-8121-1939048ab401-config\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.055893 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055873    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbc22\" (UniqueName: \"kubernetes.io/projected/88645056-d01c-4f0d-8b42-0e911ee1d7b6-kube-api-access-tbc22\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.055952 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055913    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-serving-cert\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.055952 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.055937    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9zb\" (UniqueName: \"kubernetes.io/projected/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-kube-api-access-zg9zb\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.057619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.057602    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 29 13:44:22.057949 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.057930    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 29 13:44:22.058003 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.057981    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 29 13:44:22.058048 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.057939    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfktx\""
May 29 13:44:22.064008 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.063990    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 29 13:44:22.071885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.071865    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:44:22.157099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157207 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157113    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-serving-cert\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.157207 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157131    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9zb\" (UniqueName: \"kubernetes.io/projected/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-kube-api-access-zg9zb\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.157207 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157185    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88645056-d01c-4f0d-8b42-0e911ee1d7b6-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157244    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157276    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157301    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsr5j\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157347    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzzxc\" (UniqueName: \"kubernetes.io/projected/5362786f-0b9b-4f04-8121-1939048ab401-kube-api-access-vzzxc\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157377    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xd4\" (UniqueName: \"kubernetes.io/projected/e5acb689-7c6d-4e66-8316-cc55ac46bb6a-kube-api-access-n7xd4\") pod \"volume-data-source-validator-5cf8c89d64-h6zhf\" (UID: \"e5acb689-7c6d-4e66-8316-cc55ac46bb6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"
May 29 13:44:22.157418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157400    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157438    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157463    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-config\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157507    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157546    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.157571    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157608    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5362786f-0b9b-4f04-8121-1939048ab401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.157640    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:22.657613797 +0000 UTC m=+113.139858257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157678    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.157714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157710    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5362786f-0b9b-4f04-8121-1939048ab401-config\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.158201 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157737    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbc22\" (UniqueName: \"kubernetes.io/projected/88645056-d01c-4f0d-8b42-0e911ee1d7b6-kube-api-access-tbc22\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.158201 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.157982    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-config\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.158201 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.158136    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/88645056-d01c-4f0d-8b42-0e911ee1d7b6-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.158324 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.158203    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5362786f-0b9b-4f04-8121-1939048ab401-config\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.159458 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.159444    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-serving-cert\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.159775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.159760    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5362786f-0b9b-4f04-8121-1939048ab401-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.169231 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.169208    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9zb\" (UniqueName: \"kubernetes.io/projected/4d21fd2b-778c-40b7-bd26-d28c4bbd8b28-kube-api-access-zg9zb\") pod \"service-ca-operator-57b5b68b8-9vp87\" (UID: \"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.174486 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.174464    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbc22\" (UniqueName: \"kubernetes.io/projected/88645056-d01c-4f0d-8b42-0e911ee1d7b6-kube-api-access-tbc22\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.176824 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.176800    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xd4\" (UniqueName: \"kubernetes.io/projected/e5acb689-7c6d-4e66-8316-cc55ac46bb6a-kube-api-access-n7xd4\") pod \"volume-data-source-validator-5cf8c89d64-h6zhf\" (UID: \"e5acb689-7c6d-4e66-8316-cc55ac46bb6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"
May 29 13:44:22.178068 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.178045    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzzxc\" (UniqueName: \"kubernetes.io/projected/5362786f-0b9b-4f04-8121-1939048ab401-kube-api-access-vzzxc\") pod \"kube-storage-version-migrator-operator-565644f49-5ztml\" (UID: \"5362786f-0b9b-4f04-8121-1939048ab401\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.258753 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.258710    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.258753 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.258744    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.258877 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.258760    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.258877 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.258776    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsr5j\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259012 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.258991    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259053    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259070    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259096    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259190 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259133    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259231 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.259223    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 13:44:22.259296 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.259236    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5755656bb6-bzddn: secret "image-registry-tls" not found
May 29 13:44:22.259340 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.259310    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls podName:5b0f04c9-80d3-4a18-9900-f993d181cbaf nodeName:}" failed. No retries permitted until 2026-05-29 13:44:22.759293164 +0000 UTC m=+113.241537633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls") pod "image-registry-5755656bb6-bzddn" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf") : secret "image-registry-tls" not found
May 29 13:44:22.259598 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259569    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.259673 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.259612    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.260503 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.260485    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"
May 29 13:44:22.260764 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.260742    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.261249 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.261151    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.266292 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.266274    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"
May 29 13:44:22.267861 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.267841    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.268434 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.268411    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsr5j\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.280078 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.280059    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"
May 29 13:44:22.418675 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:22.418644    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5362786f_0b9b_4f04_8121_1939048ab401.slice/crio-26336f75a3f80e84fd111d233be367c851bd2429dd79643551bfd397627d3f4c WatchSource:0}: Error finding container 26336f75a3f80e84fd111d233be367c851bd2429dd79643551bfd397627d3f4c: Status 404 returned error can't find the container with id 26336f75a3f80e84fd111d233be367c851bd2429dd79643551bfd397627d3f4c
May 29 13:44:22.419056 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.419017    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml"]
May 29 13:44:22.432403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.432377    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml" event={"ID":"5362786f-0b9b-4f04-8121-1939048ab401","Type":"ContainerStarted","Data":"26336f75a3f80e84fd111d233be367c851bd2429dd79643551bfd397627d3f4c"}
May 29 13:44:22.435305 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.435173    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87"]
May 29 13:44:22.437574 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:22.437551    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d21fd2b_778c_40b7_bd26_d28c4bbd8b28.slice/crio-e30c577e2946b8a58ae751acd3632c56012bee518838b8acd2efb63312978a6e WatchSource:0}: Error finding container e30c577e2946b8a58ae751acd3632c56012bee518838b8acd2efb63312978a6e: Status 404 returned error can't find the container with id e30c577e2946b8a58ae751acd3632c56012bee518838b8acd2efb63312978a6e
May 29 13:44:22.453769 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.453750    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf"]
May 29 13:44:22.458147 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:22.458126    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5acb689_7c6d_4e66_8316_cc55ac46bb6a.slice/crio-84dc699adc3e54a27822bc2cf10e294d2daf5b07fdcb683e6c2b33f991210c94 WatchSource:0}: Error finding container 84dc699adc3e54a27822bc2cf10e294d2daf5b07fdcb683e6c2b33f991210c94: Status 404 returned error can't find the container with id 84dc699adc3e54a27822bc2cf10e294d2daf5b07fdcb683e6c2b33f991210c94
May 29 13:44:22.663079 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.663054    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:22.663222 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.663203    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:22.663312 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.663299    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:23.663279066 +0000 UTC m=+114.145523536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:22.763600 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:22.763576    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:22.763694 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.763680    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 13:44:22.763694 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.763691    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5755656bb6-bzddn: secret "image-registry-tls" not found
May 29 13:44:22.763760 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:22.763728    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls podName:5b0f04c9-80d3-4a18-9900-f993d181cbaf nodeName:}" failed. No retries permitted until 2026-05-29 13:44:23.76371715 +0000 UTC m=+114.245961604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls") pod "image-registry-5755656bb6-bzddn" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf") : secret "image-registry-tls" not found
May 29 13:44:23.436314 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:23.436246    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87" event={"ID":"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28","Type":"ContainerStarted","Data":"e30c577e2946b8a58ae751acd3632c56012bee518838b8acd2efb63312978a6e"}
May 29 13:44:23.437948 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:23.437917    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf" event={"ID":"e5acb689-7c6d-4e66-8316-cc55ac46bb6a","Type":"ContainerStarted","Data":"84dc699adc3e54a27822bc2cf10e294d2daf5b07fdcb683e6c2b33f991210c94"}
May 29 13:44:23.670380 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:23.670340    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:23.670549 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:23.670505    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:23.670612 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:23.670591    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.670568938 +0000 UTC m=+116.152813423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:23.771403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:23.771315    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:23.771555 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:23.771480    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 13:44:23.771555 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:23.771502    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5755656bb6-bzddn: secret "image-registry-tls" not found
May 29 13:44:23.771674 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:23.771568    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls podName:5b0f04c9-80d3-4a18-9900-f993d181cbaf nodeName:}" failed. No retries permitted until 2026-05-29 13:44:25.771545687 +0000 UTC m=+116.253790156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls") pod "image-registry-5755656bb6-bzddn" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf") : secret "image-registry-tls" not found
May 29 13:44:25.443753 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.443714    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87" event={"ID":"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28","Type":"ContainerStarted","Data":"e32eae5dbb9cd32f7f2748ea0321d93722b1eff371f22173b1a99a1cca52e509"}
May 29 13:44:25.445420 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.445391    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf" event={"ID":"e5acb689-7c6d-4e66-8316-cc55ac46bb6a","Type":"ContainerStarted","Data":"7171bb55f9d95ab1172e9bdddeb9a5eb65280191fc0ff396fc47fc64fbb0e787"}
May 29 13:44:25.447873 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.447840    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml" event={"ID":"5362786f-0b9b-4f04-8121-1939048ab401","Type":"ContainerStarted","Data":"ab81187b31ac7a60159b053f7e88d7e1013c02ad4c00954e5a23de6460e5299e"}
May 29 13:44:25.461192 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.461147    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87" podStartSLOduration=1.9453316539999999 podStartE2EDuration="4.461134112s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:22.439449468 +0000 UTC m=+112.921693922" lastFinishedPulling="2026-05-29 13:44:24.955251913 +0000 UTC m=+115.437496380" observedRunningTime="2026-05-29 13:44:25.46029208 +0000 UTC m=+115.942536549" watchObservedRunningTime="2026-05-29 13:44:25.461134112 +0000 UTC m=+115.943378586"
May 29 13:44:25.477332 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.477286    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml" podStartSLOduration=1.938305674 podStartE2EDuration="4.477273955s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:22.420759308 +0000 UTC m=+112.903003763" lastFinishedPulling="2026-05-29 13:44:24.959727586 +0000 UTC m=+115.441972044" observedRunningTime="2026-05-29 13:44:25.477136037 +0000 UTC m=+115.959380515" watchObservedRunningTime="2026-05-29 13:44:25.477273955 +0000 UTC m=+115.959518428"
May 29 13:44:25.500594 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.500443    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h6zhf" podStartSLOduration=2.9957116900000003 podStartE2EDuration="4.500428141s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:22.459742823 +0000 UTC m=+112.941987283" lastFinishedPulling="2026-05-29 13:44:23.964459265 +0000 UTC m=+114.446703734" observedRunningTime="2026-05-29 13:44:25.500182425 +0000 UTC m=+115.982426894" watchObservedRunningTime="2026-05-29 13:44:25.500428141 +0000 UTC m=+115.982672621"
May 29 13:44:25.685145 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.685110    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:25.685293 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:25.685232    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:25.685332 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:25.685319    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:29.685304149 +0000 UTC m=+120.167548609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:25.786173 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:25.786144    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:25.786300 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:25.786254    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 13:44:25.786300 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:25.786284    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5755656bb6-bzddn: secret "image-registry-tls" not found
May 29 13:44:25.786372 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:25.786346    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls podName:5b0f04c9-80d3-4a18-9900-f993d181cbaf nodeName:}" failed. No retries permitted until 2026-05-29 13:44:29.786332337 +0000 UTC m=+120.268576792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls") pod "image-registry-5755656bb6-bzddn" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf") : secret "image-registry-tls" not found
May 29 13:44:26.480384 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.480357    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"]
May 29 13:44:26.483567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.483550    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"
May 29 13:44:26.486227 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.486203    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 29 13:44:26.486374 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.486227    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 29 13:44:26.486374 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.486334    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-p85t2\""
May 29 13:44:26.494700 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.494677    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"]
May 29 13:44:26.592903 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.592875    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvp9f\" (UniqueName: \"kubernetes.io/projected/1c5e3556-46e8-403b-a919-2359d384804a-kube-api-access-vvp9f\") pod \"migrator-b985f5d89-cmknx\" (UID: \"1c5e3556-46e8-403b-a919-2359d384804a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"
May 29 13:44:26.694149 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.694123    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvp9f\" (UniqueName: \"kubernetes.io/projected/1c5e3556-46e8-403b-a919-2359d384804a-kube-api-access-vvp9f\") pod \"migrator-b985f5d89-cmknx\" (UID: \"1c5e3556-46e8-403b-a919-2359d384804a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"
May 29 13:44:26.702133 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.702106    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvp9f\" (UniqueName: \"kubernetes.io/projected/1c5e3556-46e8-403b-a919-2359d384804a-kube-api-access-vvp9f\") pod \"migrator-b985f5d89-cmknx\" (UID: \"1c5e3556-46e8-403b-a919-2359d384804a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"
May 29 13:44:26.793399 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.793379    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"
May 29 13:44:26.909610 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:26.909580    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx"]
May 29 13:44:26.912599 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:26.912569    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5e3556_46e8_403b_a919_2359d384804a.slice/crio-de10be86983bbb382d404dce05f3f67a48f10c9b40cd26cc5f160893b866c36a WatchSource:0}: Error finding container de10be86983bbb382d404dce05f3f67a48f10c9b40cd26cc5f160893b866c36a: Status 404 returned error can't find the container with id de10be86983bbb382d404dce05f3f67a48f10c9b40cd26cc5f160893b866c36a
May 29 13:44:27.452868 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:27.452830    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx" event={"ID":"1c5e3556-46e8-403b-a919-2359d384804a","Type":"ContainerStarted","Data":"de10be86983bbb382d404dce05f3f67a48f10c9b40cd26cc5f160893b866c36a"}
May 29 13:44:27.705207 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:27.705142    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9b22_557e09c2-7c01-4247-89c2-107680229bf9/dns-node-resolver/0.log"
May 29 13:44:28.457386 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:28.457344    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx" event={"ID":"1c5e3556-46e8-403b-a919-2359d384804a","Type":"ContainerStarted","Data":"1ccd403196ef2573ec03daaadfe3d67b83521accbb68146755be3ffaf2de1f6c"}
May 29 13:44:28.457386 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:28.457389    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx" event={"ID":"1c5e3556-46e8-403b-a919-2359d384804a","Type":"ContainerStarted","Data":"b066739a5a859b920eced827eec0fb1b1292ac763a081767b0d4f312f197cb85"}
May 29 13:44:28.478530 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:28.478487    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-cmknx" podStartSLOduration=1.129713676 podStartE2EDuration="2.478476065s" podCreationTimestamp="2026-05-29 13:44:26 +0000 UTC" firstStartedPulling="2026-05-29 13:44:26.914395528 +0000 UTC m=+117.396639983" lastFinishedPulling="2026-05-29 13:44:28.263157918 +0000 UTC m=+118.745402372" observedRunningTime="2026-05-29 13:44:28.476805683 +0000 UTC m=+118.959050159" watchObservedRunningTime="2026-05-29 13:44:28.478476065 +0000 UTC m=+118.960720552"
May 29 13:44:28.705192 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:28.705165    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kp9zf_aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3/node-ca/0.log"
May 29 13:44:29.717105 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:29.717071    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:29.717500 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:29.717202    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:29.717500 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:29.717298    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:37.717247021 +0000 UTC m=+128.199491480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:29.818270 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:29.818241    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:29.818399 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:29.818357    2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 13:44:29.818399 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:29.818379    2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5755656bb6-bzddn: secret "image-registry-tls" not found
May 29 13:44:29.818468 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:29.818428    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls podName:5b0f04c9-80d3-4a18-9900-f993d181cbaf nodeName:}" failed. No retries permitted until 2026-05-29 13:44:37.818413456 +0000 UTC m=+128.300657911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls") pod "image-registry-5755656bb6-bzddn" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf") : secret "image-registry-tls" not found
May 29 13:44:37.776317 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:37.776244    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:37.776823 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:37.776395    2549 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 13:44:37.776823 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:37.776456    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls podName:88645056-d01c-4f0d-8b42-0e911ee1d7b6 nodeName:}" failed. No retries permitted until 2026-05-29 13:44:53.776440692 +0000 UTC m=+144.258685154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-hrrgj" (UID: "88645056-d01c-4f0d-8b42-0e911ee1d7b6") : secret "cluster-monitoring-operator-tls" not found
May 29 13:44:37.876870 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:37.876836    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:37.879173 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:37.879152    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"image-registry-5755656bb6-bzddn\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") " pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:37.966335 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:37.966312    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfktx\""
May 29 13:44:37.974555 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:37.974537    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:38.097373 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:38.096101    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:44:38.100849 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:38.100823    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0f04c9_80d3_4a18_9900_f993d181cbaf.slice/crio-81c38c0a757b6774bc6cb7f6e0d8639ea721406c3f44925ed44b0814a8c676d7 WatchSource:0}: Error finding container 81c38c0a757b6774bc6cb7f6e0d8639ea721406c3f44925ed44b0814a8c676d7: Status 404 returned error can't find the container with id 81c38c0a757b6774bc6cb7f6e0d8639ea721406c3f44925ed44b0814a8c676d7
May 29 13:44:38.483878 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:38.483801    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" event={"ID":"5b0f04c9-80d3-4a18-9900-f993d181cbaf","Type":"ContainerStarted","Data":"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"}
May 29 13:44:38.483878 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:38.483850    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" event={"ID":"5b0f04c9-80d3-4a18-9900-f993d181cbaf","Type":"ContainerStarted","Data":"81c38c0a757b6774bc6cb7f6e0d8639ea721406c3f44925ed44b0814a8c676d7"}
May 29 13:44:38.484056 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:38.483953    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:44:38.504298 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:38.504232    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" podStartSLOduration=16.504217991 podStartE2EDuration="16.504217991s" podCreationTimestamp="2026-05-29 13:44:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:44:38.50345237 +0000 UTC m=+128.985696847" watchObservedRunningTime="2026-05-29 13:44:38.504217991 +0000 UTC m=+128.986462467"
May 29 13:44:39.791557 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:39.791513    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:44:39.792010 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:39.791656    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 13:44:39.792010 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:44:39.791746    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs podName:1879625a-c0e3-45ef-a577-3261d2afd611 nodeName:}" failed. No retries permitted until 2026-05-29 13:46:41.791725613 +0000 UTC m=+252.273970085 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs") pod "network-metrics-daemon-6dspt" (UID: "1879625a-c0e3-45ef-a577-3261d2afd611") : secret "metrics-daemon-secret" not found
May 29 13:44:49.295986 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.295952    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"]
May 29 13:44:49.298959 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.298939    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.302352 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.302331    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 29 13:44:49.302494 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.302475    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ktrj9\""
May 29 13:44:49.302557 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.302482    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 29 13:44:49.311053 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.311035    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"]
May 29 13:44:49.314746 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.314723    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v5dj6"]
May 29 13:44:49.319673 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.319632    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.322604 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.322583    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8ccsm\""
May 29 13:44:49.322683 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.322583    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 13:44:49.322968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.322955    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 13:44:49.323012 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.322967    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 13:44:49.323479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.323466    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 13:44:49.329338 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.329316    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:44:49.334373 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.334351    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v5dj6"]
May 29 13:44:49.458065 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458036    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e371f92-ce6d-492d-9c6e-755bdde06cb0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.458179 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458069    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wf69\" (UniqueName: \"kubernetes.io/projected/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-api-access-9wf69\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.458179 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458106    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05667d3a-6e15-47d1-90ce-2e661b96c974-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.458179 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458138    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e371f92-ce6d-492d-9c6e-755bdde06cb0-data-volume\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.458179 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458171    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e371f92-ce6d-492d-9c6e-755bdde06cb0-crio-socket\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.458345 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.458345 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.458226    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05667d3a-6e15-47d1-90ce-2e661b96c974-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.558855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.558788    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e371f92-ce6d-492d-9c6e-755bdde06cb0-crio-socket\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.558855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.558815    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.558855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.558846    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05667d3a-6e15-47d1-90ce-2e661b96c974-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.559076 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.558911    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e371f92-ce6d-492d-9c6e-755bdde06cb0-crio-socket\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559076 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.558987    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e371f92-ce6d-492d-9c6e-755bdde06cb0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559076 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559019    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wf69\" (UniqueName: \"kubernetes.io/projected/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-api-access-9wf69\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559076 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559071    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05667d3a-6e15-47d1-90ce-2e661b96c974-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.559305 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559097    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e371f92-ce6d-492d-9c6e-755bdde06cb0-data-volume\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559475 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559454    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e371f92-ce6d-492d-9c6e-755bdde06cb0-data-volume\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559536 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559463    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.559767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.559750    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/05667d3a-6e15-47d1-90ce-2e661b96c974-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.561168 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.561152    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/05667d3a-6e15-47d1-90ce-2e661b96c974-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-vgb7f\" (UID: \"05667d3a-6e15-47d1-90ce-2e661b96c974\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.561250 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.561235    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e371f92-ce6d-492d-9c6e-755bdde06cb0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.567066 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.567049    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wf69\" (UniqueName: \"kubernetes.io/projected/3e371f92-ce6d-492d-9c6e-755bdde06cb0-kube-api-access-9wf69\") pod \"insights-runtime-extractor-v5dj6\" (UID: \"3e371f92-ce6d-492d-9c6e-755bdde06cb0\") " pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.608157 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.608137    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"
May 29 13:44:49.628836 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.628818    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v5dj6"
May 29 13:44:49.739687 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.739656    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f"]
May 29 13:44:49.742649 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:49.742614    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05667d3a_6e15_47d1_90ce_2e661b96c974.slice/crio-437f58081f32a71461edbdb3df6deb68033211d59dfc16cbe6c7e8ec403fac6a WatchSource:0}: Error finding container 437f58081f32a71461edbdb3df6deb68033211d59dfc16cbe6c7e8ec403fac6a: Status 404 returned error can't find the container with id 437f58081f32a71461edbdb3df6deb68033211d59dfc16cbe6c7e8ec403fac6a
May 29 13:44:49.756625 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:49.756591    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v5dj6"]
May 29 13:44:49.759029 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:49.759006    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e371f92_ce6d_492d_9c6e_755bdde06cb0.slice/crio-8e1e62c078c78459ed2fdc4c7e6409055064e6c57e661b84539c07cddd90bc2f WatchSource:0}: Error finding container 8e1e62c078c78459ed2fdc4c7e6409055064e6c57e661b84539c07cddd90bc2f: Status 404 returned error can't find the container with id 8e1e62c078c78459ed2fdc4c7e6409055064e6c57e661b84539c07cddd90bc2f
May 29 13:44:50.519119 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:50.519091    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5dj6" event={"ID":"3e371f92-ce6d-492d-9c6e-755bdde06cb0","Type":"ContainerStarted","Data":"f057b07e0899f69e6c410898dc0757475105516092bc21bd5da0bb7fe6d6de1c"}
May 29 13:44:50.519467 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:50.519131    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5dj6" event={"ID":"3e371f92-ce6d-492d-9c6e-755bdde06cb0","Type":"ContainerStarted","Data":"8e1e62c078c78459ed2fdc4c7e6409055064e6c57e661b84539c07cddd90bc2f"}
May 29 13:44:50.520111 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:50.520088    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f" event={"ID":"05667d3a-6e15-47d1-90ce-2e661b96c974","Type":"ContainerStarted","Data":"437f58081f32a71461edbdb3df6deb68033211d59dfc16cbe6c7e8ec403fac6a"}
May 29 13:44:51.524379 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:51.524343    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f" event={"ID":"05667d3a-6e15-47d1-90ce-2e661b96c974","Type":"ContainerStarted","Data":"1d8ab97ff43d153875320061a2bb7cc5b63812e2dcc640f8ca9a117c3e3be583"}
May 29 13:44:51.526026 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:51.525998    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5dj6" event={"ID":"3e371f92-ce6d-492d-9c6e-755bdde06cb0","Type":"ContainerStarted","Data":"3c273f1ef9742dda0ef65d1cd4ad09cf38590640937e868b30b4c48d88ff3060"}
May 29 13:44:51.541343 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:51.541298    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-vgb7f" podStartSLOduration=1.3353191340000001 podStartE2EDuration="2.541284289s" podCreationTimestamp="2026-05-29 13:44:49 +0000 UTC" firstStartedPulling="2026-05-29 13:44:49.744385167 +0000 UTC m=+140.226629627" lastFinishedPulling="2026-05-29 13:44:50.950350318 +0000 UTC m=+141.432594782" observedRunningTime="2026-05-29 13:44:51.539852066 +0000 UTC m=+142.022096542" watchObservedRunningTime="2026-05-29 13:44:51.541284289 +0000 UTC m=+142.023528763"
May 29 13:44:52.530362 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:52.530323    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v5dj6" event={"ID":"3e371f92-ce6d-492d-9c6e-755bdde06cb0","Type":"ContainerStarted","Data":"81170d741b5021723b041728078db0a014d28cf68345b9b2d47f270651352818"}
May 29 13:44:52.553775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:52.553729    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v5dj6" podStartSLOduration=1.3643851470000001 podStartE2EDuration="3.553717516s" podCreationTimestamp="2026-05-29 13:44:49 +0000 UTC" firstStartedPulling="2026-05-29 13:44:49.816496279 +0000 UTC m=+140.298740734" lastFinishedPulling="2026-05-29 13:44:52.005828637 +0000 UTC m=+142.488073103" observedRunningTime="2026-05-29 13:44:52.552034649 +0000 UTC m=+143.034279126" watchObservedRunningTime="2026-05-29 13:44:52.553717516 +0000 UTC m=+143.035961993"
May 29 13:44:53.790344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:53.790295    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:53.792626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:53.792596    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/88645056-d01c-4f0d-8b42-0e911ee1d7b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-hrrgj\" (UID: \"88645056-d01c-4f0d-8b42-0e911ee1d7b6\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:54.077319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:54.077238    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rzw26\""
May 29 13:44:54.085287 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:54.085253    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"
May 29 13:44:54.207010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:54.206982    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj"]
May 29 13:44:54.210178 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:54.210151    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88645056_d01c_4f0d_8b42_0e911ee1d7b6.slice/crio-abd0a9fe7c9966a37ce09661ddcda2047653fb78173de635c606f7b97b0650c7 WatchSource:0}: Error finding container abd0a9fe7c9966a37ce09661ddcda2047653fb78173de635c606f7b97b0650c7: Status 404 returned error can't find the container with id abd0a9fe7c9966a37ce09661ddcda2047653fb78173de635c606f7b97b0650c7
May 29 13:44:54.536516 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:54.536486    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj" event={"ID":"88645056-d01c-4f0d-8b42-0e911ee1d7b6","Type":"ContainerStarted","Data":"abd0a9fe7c9966a37ce09661ddcda2047653fb78173de635c606f7b97b0650c7"}
May 29 13:44:56.540683 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.540650    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"]
May 29 13:44:56.543703 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.543676    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj" event={"ID":"88645056-d01c-4f0d-8b42-0e911ee1d7b6","Type":"ContainerStarted","Data":"d9040b37b286537394231a5b24383b86e4cfba28b4b4b9b5dd1997f34c7abc90"}
May 29 13:44:56.543840 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.543790    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:56.546095 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.546076    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 29 13:44:56.546196 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.546167    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nwrlj\""
May 29 13:44:56.553563 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.553538    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"]
May 29 13:44:56.562752 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.562714    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-hrrgj" podStartSLOduration=33.732877577 podStartE2EDuration="35.562702878s" podCreationTimestamp="2026-05-29 13:44:21 +0000 UTC" firstStartedPulling="2026-05-29 13:44:54.21197304 +0000 UTC m=+144.694217495" lastFinishedPulling="2026-05-29 13:44:56.041798337 +0000 UTC m=+146.524042796" observedRunningTime="2026-05-29 13:44:56.562471364 +0000 UTC m=+147.044715842" watchObservedRunningTime="2026-05-29 13:44:56.562702878 +0000 UTC m=+147.044947355"
May 29 13:44:56.610511 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.610478    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e6ccd0e-2da5-44ae-b138-e0dda8692936-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9\" (UID: \"4e6ccd0e-2da5-44ae-b138-e0dda8692936\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:56.711630 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.711594    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e6ccd0e-2da5-44ae-b138-e0dda8692936-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9\" (UID: \"4e6ccd0e-2da5-44ae-b138-e0dda8692936\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:56.713936 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.713913    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4e6ccd0e-2da5-44ae-b138-e0dda8692936-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9\" (UID: \"4e6ccd0e-2da5-44ae-b138-e0dda8692936\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:56.853179 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.853105    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:56.970192 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:56.970164    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"]
May 29 13:44:56.973853 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:44:56.973824    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ccd0e_2da5_44ae_b138_e0dda8692936.slice/crio-1197cb381590371a8ba740726fbad44b09fcaabbdb951e9b740a337095d0621b WatchSource:0}: Error finding container 1197cb381590371a8ba740726fbad44b09fcaabbdb951e9b740a337095d0621b: Status 404 returned error can't find the container with id 1197cb381590371a8ba740726fbad44b09fcaabbdb951e9b740a337095d0621b
May 29 13:44:57.547349 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:57.547306    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9" event={"ID":"4e6ccd0e-2da5-44ae-b138-e0dda8692936","Type":"ContainerStarted","Data":"1197cb381590371a8ba740726fbad44b09fcaabbdb951e9b740a337095d0621b"}
May 29 13:44:58.550877 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:58.550834    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9" event={"ID":"4e6ccd0e-2da5-44ae-b138-e0dda8692936","Type":"ContainerStarted","Data":"d0e735c1833c84e58e2a8c798340cdc5bc6c0ce4fca17765a093511700ebdf2c"}
May 29 13:44:58.551383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:58.550988    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:58.555777 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:58.555756    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9"
May 29 13:44:58.569609 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:58.569563    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9" podStartSLOduration=1.5324484219999999 podStartE2EDuration="2.56954954s" podCreationTimestamp="2026-05-29 13:44:56 +0000 UTC" firstStartedPulling="2026-05-29 13:44:56.975690966 +0000 UTC m=+147.457935421" lastFinishedPulling="2026-05-29 13:44:58.01279207 +0000 UTC m=+148.495036539" observedRunningTime="2026-05-29 13:44:58.569295788 +0000 UTC m=+149.051540266" watchObservedRunningTime="2026-05-29 13:44:58.56954954 +0000 UTC m=+149.051794017"
May 29 13:44:59.334307 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:59.334248    2549 patch_prober.go:28] interesting pod/image-registry-5755656bb6-bzddn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 29 13:44:59.334464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:44:59.334324    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 13:45:03.997169 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:03.997133    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"]
May 29 13:45:03.999990 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:03.999973    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.002989 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.002948    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 29 13:45:04.003131 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.003104    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 13:45:04.003227 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.003209    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7t9hr\""
May 29 13:45:04.003304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.003218    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 29 13:45:04.014060 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.014036    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"]
May 29 13:45:04.041683 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.041649    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ww2x4"]
May 29 13:45:04.043785 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.043770    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.051208 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.051189    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 13:45:04.052084 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.052037    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 13:45:04.052201 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.052145    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 13:45:04.052289 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.052252    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjbq9\""
May 29 13:45:04.062733 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062706    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-textfile\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.062821 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062740    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btkbb\" (UniqueName: \"kubernetes.io/projected/97fa0e46-f896-4f98-a6ff-e8d689198ac8-kube-api-access-btkbb\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.062821 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062774    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97fa0e46-f896-4f98-a6ff-e8d689198ac8-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.062821 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062803    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-root\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.062919 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062828    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.062919 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062846    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.062919 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062895    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-wtmp\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.063010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062924    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-metrics-client-ca\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.063010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062947    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.063010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.062978    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-sys\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.063010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.063005    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxw5\" (UniqueName: \"kubernetes.io/projected/1adeec54-bec5-4afa-aada-4a6874f9a1bd-kube-api-access-mjxw5\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.063129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.063040    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.063129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.063059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164096 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164054    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-sys\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164096 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164098    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxw5\" (UniqueName: \"kubernetes.io/projected/1adeec54-bec5-4afa-aada-4a6874f9a1bd-kube-api-access-mjxw5\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164131    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164149    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164161    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-sys\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164169    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-textfile\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164226    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btkbb\" (UniqueName: \"kubernetes.io/projected/97fa0e46-f896-4f98-a6ff-e8d689198ac8-kube-api-access-btkbb\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:04.164290    2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 29 13:45:04.164383 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:04.164360    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls podName:1adeec54-bec5-4afa-aada-4a6874f9a1bd nodeName:}" failed. No retries permitted until 2026-05-29 13:45:04.664341468 +0000 UTC m=+155.146585947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls") pod "node-exporter-ww2x4" (UID: "1adeec54-bec5-4afa-aada-4a6874f9a1bd") : secret "node-exporter-tls" not found
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164430    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97fa0e46-f896-4f98-a6ff-e8d689198ac8-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164471    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-root\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164513    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-root\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164511    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164547    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164583    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-wtmp\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164617    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-metrics-client-ca\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164630    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-textfile\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164644    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:04.164652    2549 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 29 13:45:04.164744 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:04.164717    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls podName:97fa0e46-f896-4f98-a6ff-e8d689198ac8 nodeName:}" failed. No retries permitted until 2026-05-29 13:45:04.664701393 +0000 UTC m=+155.146945866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-vkmwt" (UID: "97fa0e46-f896-4f98-a6ff-e8d689198ac8") : secret "openshift-state-metrics-tls" not found
May 29 13:45:04.165297 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.164801    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-wtmp\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.165297 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.165069    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.165297 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.165100    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97fa0e46-f896-4f98-a6ff-e8d689198ac8-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.165297 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.165119    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adeec54-bec5-4afa-aada-4a6874f9a1bd-metrics-client-ca\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.166801 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.166780    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.166899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.166800    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.173225 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.173197    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btkbb\" (UniqueName: \"kubernetes.io/projected/97fa0e46-f896-4f98-a6ff-e8d689198ac8-kube-api-access-btkbb\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.173383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.173363    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxw5\" (UniqueName: \"kubernetes.io/projected/1adeec54-bec5-4afa-aada-4a6874f9a1bd-kube-api-access-mjxw5\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.668678 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.668637    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.668920 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.668807    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.671202 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.671168    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1adeec54-bec5-4afa-aada-4a6874f9a1bd-node-exporter-tls\") pod \"node-exporter-ww2x4\" (UID: \"1adeec54-bec5-4afa-aada-4a6874f9a1bd\") " pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.671342 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.671218    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/97fa0e46-f896-4f98-a6ff-e8d689198ac8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-vkmwt\" (UID: \"97fa0e46-f896-4f98-a6ff-e8d689198ac8\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.908728 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.908691    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"
May 29 13:45:04.951714 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:04.951624    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ww2x4"
May 29 13:45:04.962160 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:04.962108    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adeec54_bec5_4afa_aada_4a6874f9a1bd.slice/crio-26312029a246e11dd06dcdc30958a0ea86c6261555b330d647e511b541c1eb44 WatchSource:0}: Error finding container 26312029a246e11dd06dcdc30958a0ea86c6261555b330d647e511b541c1eb44: Status 404 returned error can't find the container with id 26312029a246e11dd06dcdc30958a0ea86c6261555b330d647e511b541c1eb44
May 29 13:45:05.045842 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.045811    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt"]
May 29 13:45:05.048861 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:05.048837    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fa0e46_f896_4f98_a6ff_e8d689198ac8.slice/crio-c94b6366c9efe98e32be50b3fe56dde75cfe9c5475107d752cfc196a2d3044f7 WatchSource:0}: Error finding container c94b6366c9efe98e32be50b3fe56dde75cfe9c5475107d752cfc196a2d3044f7: Status 404 returned error can't find the container with id c94b6366c9efe98e32be50b3fe56dde75cfe9c5475107d752cfc196a2d3044f7
May 29 13:45:05.097744 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.097718    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:45:05.100672 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.100650    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.103041 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.102992    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 13:45:05.103041 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103003    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 13:45:05.103041 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103003    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 13:45:05.103274 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103007    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 13:45:05.103390 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103374    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 13:45:05.103468 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103425    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 13:45:05.103541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103526    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 13:45:05.103749 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103728    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 13:45:05.103749 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103743    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8wpgd\""
May 29 13:45:05.103905 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.103821    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 13:45:05.113419 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.113397    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:45:05.173073 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173049    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173189 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173101    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173189 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173134    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173303 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173201    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173303 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173255    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173413 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173316    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173413 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173392    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173483 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173442    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173514 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173484    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173591 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173576    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173605    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173674 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173635    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpsnb\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.173674 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.173661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274102 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274074    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274127    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274145    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274167    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpsnb\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274193    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274232    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274296 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274291    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274321    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274349    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274380    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274406    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274454    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274477    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.274901 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274815    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.275385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.274974    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.275870 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.275550    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.277358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.277337    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.277500 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.277450    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.278468 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.278421    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.278468 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.278437    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.278619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.278494    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.278619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.278550    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.278852 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.278831    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.279363 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.279346    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.279540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.279519    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.283580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.283551    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpsnb\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb\") pod \"alertmanager-main-0\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.410912 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.410880    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:45:05.568384 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.568272    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww2x4" event={"ID":"1adeec54-bec5-4afa-aada-4a6874f9a1bd","Type":"ContainerStarted","Data":"26312029a246e11dd06dcdc30958a0ea86c6261555b330d647e511b541c1eb44"}
May 29 13:45:05.570927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.570898    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt" event={"ID":"97fa0e46-f896-4f98-a6ff-e8d689198ac8","Type":"ContainerStarted","Data":"477e5620c8c955d111d93c648542caf944e90e954507c73464da15176b0a6eda"}
May 29 13:45:05.571031 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.570938    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt" event={"ID":"97fa0e46-f896-4f98-a6ff-e8d689198ac8","Type":"ContainerStarted","Data":"c75e198a30c896c3d394bdbc3b2d39a71b521f53f9e9514f71f6d8d485f3d994"}
May 29 13:45:05.571031 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.570954    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt" event={"ID":"97fa0e46-f896-4f98-a6ff-e8d689198ac8","Type":"ContainerStarted","Data":"c94b6366c9efe98e32be50b3fe56dde75cfe9c5475107d752cfc196a2d3044f7"}
May 29 13:45:05.571374 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:05.571356    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:45:05.758038 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:05.758000    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0158560b_7f86_4cad_b64a_39e6623836a9.slice/crio-2af7df9f38e08209ba305c06833946196d28cc248dcddd5a6bb334498663a6af WatchSource:0}: Error finding container 2af7df9f38e08209ba305c06833946196d28cc248dcddd5a6bb334498663a6af: Status 404 returned error can't find the container with id 2af7df9f38e08209ba305c06833946196d28cc248dcddd5a6bb334498663a6af
May 29 13:45:06.114293 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.114194    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86d85c69b4-75jzl"]
May 29 13:45:06.117585 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.117564    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.121874 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.121850    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 29 13:45:06.122129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.122111    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 29 13:45:06.122326 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.122281    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-98wkf\""
May 29 13:45:06.124879 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.124490    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 29 13:45:06.124879 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.124655    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 29 13:45:06.124996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.124878    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4p50nd8lmos9h\""
May 29 13:45:06.125165 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.125074    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 29 13:45:06.136754 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.136730    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86d85c69b4-75jzl"]
May 29 13:45:06.182215 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182191    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182342 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182221    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182342 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182242    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182342 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182279    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hv65\" (UniqueName: \"kubernetes.io/projected/53fc898f-8aa5-4864-b70f-dfc366578623-kube-api-access-5hv65\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182453 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182389    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-grpc-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182453 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182429    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182532 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182516    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fc898f-8aa5-4864-b70f-dfc366578623-metrics-client-ca\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.182575 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.182560    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283492 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283459    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fc898f-8aa5-4864-b70f-dfc366578623-metrics-client-ca\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283658 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283504    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283658 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283550    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283658 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283574    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283667    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283725    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hv65\" (UniqueName: \"kubernetes.io/projected/53fc898f-8aa5-4864-b70f-dfc366578623-kube-api-access-5hv65\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283779    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-grpc-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.283825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.283813    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.284216 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.284191    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53fc898f-8aa5-4864-b70f-dfc366578623-metrics-client-ca\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287039    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287046    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287325 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287235    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-grpc-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287356    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287372    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-tls\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.287479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.287409    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/53fc898f-8aa5-4864-b70f-dfc366578623-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.293363 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.293339    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hv65\" (UniqueName: \"kubernetes.io/projected/53fc898f-8aa5-4864-b70f-dfc366578623-kube-api-access-5hv65\") pod \"thanos-querier-86d85c69b4-75jzl\" (UID: \"53fc898f-8aa5-4864-b70f-dfc366578623\") " pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.427796 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.427711    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:06.459804 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:06.459754    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6hrkf" podUID="8a195377-00dd-4e32-b515-491c5986e765"
May 29 13:45:06.469128 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:06.469089    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ql579" podUID="f9d0cd67-e3f9-4d13-867c-e87844047b23"
May 29 13:45:06.562888 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.562739    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86d85c69b4-75jzl"]
May 29 13:45:06.565721 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:06.565691    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53fc898f_8aa5_4864_b70f_dfc366578623.slice/crio-75553266ff6df02b919d1d0b99bc82b7bd0a98346dd2bc681fa7d8572f614ae8 WatchSource:0}: Error finding container 75553266ff6df02b919d1d0b99bc82b7bd0a98346dd2bc681fa7d8572f614ae8: Status 404 returned error can't find the container with id 75553266ff6df02b919d1d0b99bc82b7bd0a98346dd2bc681fa7d8572f614ae8
May 29 13:45:06.575244 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.575217    2549 generic.go:358] "Generic (PLEG): container finished" podID="1adeec54-bec5-4afa-aada-4a6874f9a1bd" containerID="18a6cb5393aebb91d7facfa61276d0a48a0345763467f783e1a11c0aa390f0a2" exitCode=0
May 29 13:45:06.575355 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.575321    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww2x4" event={"ID":"1adeec54-bec5-4afa-aada-4a6874f9a1bd","Type":"ContainerDied","Data":"18a6cb5393aebb91d7facfa61276d0a48a0345763467f783e1a11c0aa390f0a2"}
May 29 13:45:06.576574 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.576543    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"2af7df9f38e08209ba305c06833946196d28cc248dcddd5a6bb334498663a6af"}
May 29 13:45:06.578131 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.578097    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt" event={"ID":"97fa0e46-f896-4f98-a6ff-e8d689198ac8","Type":"ContainerStarted","Data":"a88c409f854fc5cfc688a31f9bb760597aae59da6c71e87fdb56b87d88b0f153"}
May 29 13:45:06.579185 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.579165    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"75553266ff6df02b919d1d0b99bc82b7bd0a98346dd2bc681fa7d8572f614ae8"}
May 29 13:45:06.579284 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.579215    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:06.615952 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:06.615906    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-vkmwt" podStartSLOduration=2.606489534 podStartE2EDuration="3.615890841s" podCreationTimestamp="2026-05-29 13:45:03 +0000 UTC" firstStartedPulling="2026-05-29 13:45:05.161775093 +0000 UTC m=+155.644019547" lastFinishedPulling="2026-05-29 13:45:06.171176397 +0000 UTC m=+156.653420854" observedRunningTime="2026-05-29 13:45:06.615649118 +0000 UTC m=+157.097893600" watchObservedRunningTime="2026-05-29 13:45:06.615890841 +0000 UTC m=+157.098135318"
May 29 13:45:07.003669 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.003634    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-dzdnm"]
May 29 13:45:07.005912 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.005896    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:07.008809 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.008762    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 13:45:07.008809 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.008762    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-thpxv\""
May 29 13:45:07.009096 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.009082    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 13:45:07.020200 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.020162    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dzdnm"]
May 29 13:45:07.092548 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.092456    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vbn\" (UniqueName: \"kubernetes.io/projected/d658f228-bc05-415e-9c0b-601b030dbdef-kube-api-access-k8vbn\") pod \"downloads-57bd96b888-dzdnm\" (UID: \"d658f228-bc05-415e-9c0b-601b030dbdef\") " pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:07.193589 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.193556    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vbn\" (UniqueName: \"kubernetes.io/projected/d658f228-bc05-415e-9c0b-601b030dbdef-kube-api-access-k8vbn\") pod \"downloads-57bd96b888-dzdnm\" (UID: \"d658f228-bc05-415e-9c0b-601b030dbdef\") " pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:07.203992 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.203968    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vbn\" (UniqueName: \"kubernetes.io/projected/d658f228-bc05-415e-9c0b-601b030dbdef-kube-api-access-k8vbn\") pod \"downloads-57bd96b888-dzdnm\" (UID: \"d658f228-bc05-415e-9c0b-601b030dbdef\") " pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:07.315093 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.315061    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:07.449802 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.449774    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-dzdnm"]
May 29 13:45:07.453534 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:07.453502    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd658f228_bc05_415e_9c0b_601b030dbdef.slice/crio-ecae54f127890dda67306d328925afc0757d60bc1ad28d0a4641e9b6d3fbdaa4 WatchSource:0}: Error finding container ecae54f127890dda67306d328925afc0757d60bc1ad28d0a4641e9b6d3fbdaa4: Status 404 returned error can't find the container with id ecae54f127890dda67306d328925afc0757d60bc1ad28d0a4641e9b6d3fbdaa4
May 29 13:45:07.584208 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.584179    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww2x4" event={"ID":"1adeec54-bec5-4afa-aada-4a6874f9a1bd","Type":"ContainerStarted","Data":"3acc73577443b3c71a05ceb582c513f82f80771036e4b020756c5798f21c8ae0"}
May 29 13:45:07.584385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.584217    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ww2x4" event={"ID":"1adeec54-bec5-4afa-aada-4a6874f9a1bd","Type":"ContainerStarted","Data":"f438cda487b0d92287bbb550dc4149b89d88c3a8e3a5774b9fed714b5fac4e61"}
May 29 13:45:07.585738 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.585708    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009" exitCode=0
May 29 13:45:07.585872 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.585800    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"}
May 29 13:45:07.586970 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.586946    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dzdnm" event={"ID":"d658f228-bc05-415e-9c0b-601b030dbdef","Type":"ContainerStarted","Data":"ecae54f127890dda67306d328925afc0757d60bc1ad28d0a4641e9b6d3fbdaa4"}
May 29 13:45:07.606662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:07.606617    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ww2x4" podStartSLOduration=2.785868902 podStartE2EDuration="3.606603795s" podCreationTimestamp="2026-05-29 13:45:04 +0000 UTC" firstStartedPulling="2026-05-29 13:45:04.964210985 +0000 UTC m=+155.446455443" lastFinishedPulling="2026-05-29 13:45:05.784945866 +0000 UTC m=+156.267190336" observedRunningTime="2026-05-29 13:45:07.605926079 +0000 UTC m=+158.088170558" watchObservedRunningTime="2026-05-29 13:45:07.606603795 +0000 UTC m=+158.088848272"
May 29 13:45:08.117872 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:08.117822    2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6dspt" podUID="1879625a-c0e3-45ef-a577-3261d2afd611"
May 29 13:45:08.306095 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.306061    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"]
May 29 13:45:08.308580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.308564    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.311332 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.311309    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8ri4h3ffjth38\""
May 29 13:45:08.311455 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.311388    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 29 13:45:08.312248 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.312231    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 29 13:45:08.312338 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.312254    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 29 13:45:08.312338 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.312299    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 29 13:45:08.312418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.312337    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-js28m\""
May 29 13:45:08.325129 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.325109    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"]
May 29 13:45:08.403231 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403206    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-metrics-server-audit-profiles\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403360 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403248    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403360 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403335    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-tls\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403478 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403364    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-client-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403478 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403427    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-client-certs\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403478 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403453    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-audit-log\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.403630 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.403505    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hr9z\" (UniqueName: \"kubernetes.io/projected/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-kube-api-access-2hr9z\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504564    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-tls\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504608    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-client-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504675    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-client-certs\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504703    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-audit-log\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504751    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hr9z\" (UniqueName: \"kubernetes.io/projected/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-kube-api-access-2hr9z\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504788    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-metrics-server-audit-profiles\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.505542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.504838    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.506002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.505610    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.506090 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.506054    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-audit-log\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.506675 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.506652    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-metrics-server-audit-profiles\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.509597 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.509060    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-tls\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.509597 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.509556    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-secret-metrics-server-client-certs\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.510347 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.510306    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-client-ca-bundle\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.513642 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.513621    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hr9z\" (UniqueName: \"kubernetes.io/projected/44399bc5-2bf2-47af-b688-3d83ba6dcb1b-kube-api-access-2hr9z\") pod \"metrics-server-5d68dbcdd9-8gjph\" (UID: \"44399bc5-2bf2-47af-b688-3d83ba6dcb1b\") " pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.592421 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.592381    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"4b54e7476ffdc58b990526a901b6a1eb4cc2f042c9cd6cb5d66a6026d0c9b572"}
May 29 13:45:08.592421 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.592423    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"e59932017e9baa24f04b07523e81c7619f897ad54a253d6ed2b4916818cfaa3e"}
May 29 13:45:08.592421 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.592433    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"0f0ee2b771029dc49af6ca8e6070cbecf215ddcbcdc390ea0d2718367e70f1cc"}
May 29 13:45:08.618415 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.618392    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:08.761246 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:08.761223    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"]
May 29 13:45:08.764248 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:08.764215    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44399bc5_2bf2_47af_b688_3d83ba6dcb1b.slice/crio-3e52e9885a7977ad2abe9ed203921bd6f31266c3fee199456f675e5e1810ca39 WatchSource:0}: Error finding container 3e52e9885a7977ad2abe9ed203921bd6f31266c3fee199456f675e5e1810ca39: Status 404 returned error can't find the container with id 3e52e9885a7977ad2abe9ed203921bd6f31266c3fee199456f675e5e1810ca39
May 29 13:45:09.335941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:09.335683    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:45:09.598113 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:09.598012    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph" event={"ID":"44399bc5-2bf2-47af-b688-3d83ba6dcb1b","Type":"ContainerStarted","Data":"3e52e9885a7977ad2abe9ed203921bd6f31266c3fee199456f675e5e1810ca39"}
May 29 13:45:10.296740 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.296703    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:45:10.301091 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.301067    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.303489 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.303461    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 29 13:45:10.303604 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.303539    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 29 13:45:10.303604 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.303558    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 29 13:45:10.304039 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.304026    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 29 13:45:10.304442 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.304410    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 29 13:45:10.304528 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.304515    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 29 13:45:10.304843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.304802    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 29 13:45:10.304934 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.304868    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 29 13:45:10.305100 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.305082    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-48bsm\""
May 29 13:45:10.305172 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.305153    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 29 13:45:10.305407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.305387    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3ealrve0m9qpv\""
May 29 13:45:10.305407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.305404    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 29 13:45:10.305570 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.305423    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 29 13:45:10.307987 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.307870    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 29 13:45:10.318632 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.318610    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422311    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422349    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8nk\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422461    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422489    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422555    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422648    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422688    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422724    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422758    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422797    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422844    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422875    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422956    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.423344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.422989    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.424806 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.423014    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.424806 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.423036    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.524971    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525019    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525079    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525104    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525135    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8nk\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525168    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525198    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525249    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525325    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525355    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525393    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525419    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525450    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525514    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525550    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525579    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525650    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.525826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.525693    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.528669 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.526880    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.528669 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.527571    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.530279 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.529197    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.530279 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.529444    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.530279 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.530017    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.530474 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.530436    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.531130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.531096    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.532173    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.532227    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.532646    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.532764    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.533104    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.533200    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.533567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.533524    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.534234 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.534198    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.534839 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.534361    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.534957 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.534923    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.540287 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.540199    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8nk\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk\") pod \"prometheus-k8s-0\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.605426 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.605394    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"7ed8579447f1cc0bd7e97ae9f0363832403e51c03c53cddcf0958ba5566e2e04"}
May 29 13:45:10.605526 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.605438    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"eedddb0c088c6418fed9932f0b8eaccde667eea1a4e13160b0d3b1531c4c4218"}
May 29 13:45:10.605526 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.605453    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" event={"ID":"53fc898f-8aa5-4864-b70f-dfc366578623","Type":"ContainerStarted","Data":"c927bf5b0bbf0eb01cf46457342812fb3dae348bcb9b518376e833203f54d89b"}
May 29 13:45:10.605747 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.605729    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:10.607441 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.607415    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph" event={"ID":"44399bc5-2bf2-47af-b688-3d83ba6dcb1b","Type":"ContainerStarted","Data":"8bfdaabc61963636e3d82edf08a92b1652c413020b22e8b50019c8a4dd43bd30"}
May 29 13:45:10.610890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.610838    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"}
May 29 13:45:10.610890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.610860    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"}
May 29 13:45:10.610890 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.610869    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"}
May 29 13:45:10.620183 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.619882    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:10.630932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.630276    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl" podStartSLOduration=1.320100021 podStartE2EDuration="4.630244115s" podCreationTimestamp="2026-05-29 13:45:06 +0000 UTC" firstStartedPulling="2026-05-29 13:45:06.567926617 +0000 UTC m=+157.050171074" lastFinishedPulling="2026-05-29 13:45:09.8780707 +0000 UTC m=+160.360315168" observedRunningTime="2026-05-29 13:45:10.627924393 +0000 UTC m=+161.110168869" watchObservedRunningTime="2026-05-29 13:45:10.630244115 +0000 UTC m=+161.112488592"
May 29 13:45:10.649218 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.648803    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph" podStartSLOduration=1.033721876 podStartE2EDuration="2.64878723s" podCreationTimestamp="2026-05-29 13:45:08 +0000 UTC" firstStartedPulling="2026-05-29 13:45:08.766922361 +0000 UTC m=+159.249166824" lastFinishedPulling="2026-05-29 13:45:10.381987722 +0000 UTC m=+160.864232178" observedRunningTime="2026-05-29 13:45:10.647498582 +0000 UTC m=+161.129743060" watchObservedRunningTime="2026-05-29 13:45:10.64878723 +0000 UTC m=+161.131031709"
May 29 13:45:10.782067 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:10.781697    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:45:10.783946 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:10.783915    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac57da8_a23b_4f39_bdc9_26d745ab8efb.slice/crio-1b2476b7e57eed38f3a571a9e166a7ff853ddced55d8fe2fe63fc186dde276e7 WatchSource:0}: Error finding container 1b2476b7e57eed38f3a571a9e166a7ff853ddced55d8fe2fe63fc186dde276e7: Status 404 returned error can't find the container with id 1b2476b7e57eed38f3a571a9e166a7ff853ddced55d8fe2fe63fc186dde276e7
May 29 13:45:11.235178 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.235090    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:11.238051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.237965    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a195377-00dd-4e32-b515-491c5986e765-metrics-tls\") pod \"dns-default-6hrkf\" (UID: \"8a195377-00dd-4e32-b515-491c5986e765\") " pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:11.335767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.335730    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:45:11.338360 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.338336    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9d0cd67-e3f9-4d13-867c-e87844047b23-cert\") pod \"ingress-canary-ql579\" (UID: \"f9d0cd67-e3f9-4d13-867c-e87844047b23\") " pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:45:11.383008 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.382982    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdfdw\""
May 29 13:45:11.390605 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.390576    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:11.537360 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.537317    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hrkf"]
May 29 13:45:11.539187 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:11.539158    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a195377_00dd_4e32_b515_491c5986e765.slice/crio-a2aae83d531bd7a9b995abec598a9c33d87324fbe63f33e62cac94bb406d3eaa WatchSource:0}: Error finding container a2aae83d531bd7a9b995abec598a9c33d87324fbe63f33e62cac94bb406d3eaa: Status 404 returned error can't find the container with id a2aae83d531bd7a9b995abec598a9c33d87324fbe63f33e62cac94bb406d3eaa
May 29 13:45:11.616372 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.616337    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="fddefd31f05b6e6f1e247099ac0db4d756cf77f8c733f6e5510806127c33dcae" exitCode=0
May 29 13:45:11.616500 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.616427    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"fddefd31f05b6e6f1e247099ac0db4d756cf77f8c733f6e5510806127c33dcae"}
May 29 13:45:11.616500 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.616466    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"1b2476b7e57eed38f3a571a9e166a7ff853ddced55d8fe2fe63fc186dde276e7"}
May 29 13:45:11.619921 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.619891    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"}
May 29 13:45:11.620019 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.619927    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"}
May 29 13:45:11.620019 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.619942    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerStarted","Data":"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"}
May 29 13:45:11.621004 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.620978    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hrkf" event={"ID":"8a195377-00dd-4e32-b515-491c5986e765","Type":"ContainerStarted","Data":"a2aae83d531bd7a9b995abec598a9c33d87324fbe63f33e62cac94bb406d3eaa"}
May 29 13:45:11.674578 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:11.674531    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.551129135 podStartE2EDuration="6.674515916s" podCreationTimestamp="2026-05-29 13:45:05 +0000 UTC" firstStartedPulling="2026-05-29 13:45:05.76048212 +0000 UTC m=+156.242726578" lastFinishedPulling="2026-05-29 13:45:09.883868891 +0000 UTC m=+160.366113359" observedRunningTime="2026-05-29 13:45:11.673864991 +0000 UTC m=+162.156109470" watchObservedRunningTime="2026-05-29 13:45:11.674515916 +0000 UTC m=+162.156760396"
May 29 13:45:13.630408 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:13.630370    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hrkf" event={"ID":"8a195377-00dd-4e32-b515-491c5986e765","Type":"ContainerStarted","Data":"64be5501d430b0b87487643c9d10c2047e4e1968030cd2bc5060d61c34613ed4"}
May 29 13:45:13.630840 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:13.630418    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hrkf" event={"ID":"8a195377-00dd-4e32-b515-491c5986e765","Type":"ContainerStarted","Data":"4615c89230346b12292deac6a0caa5eb60f23a1ad51fb9c4de56ebc2d6b852cb"}
May 29 13:45:13.630840 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:13.630642    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:13.649982 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:13.649926    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6hrkf" podStartSLOduration=129.215491025 podStartE2EDuration="2m10.649908126s" podCreationTimestamp="2026-05-29 13:43:03 +0000 UTC" firstStartedPulling="2026-05-29 13:45:11.541458198 +0000 UTC m=+162.023702657" lastFinishedPulling="2026-05-29 13:45:12.975875291 +0000 UTC m=+163.458119758" observedRunningTime="2026-05-29 13:45:13.649007355 +0000 UTC m=+164.131251843" watchObservedRunningTime="2026-05-29 13:45:13.649908126 +0000 UTC m=+164.132152602"
May 29 13:45:14.349455 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.349325    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerName="registry" containerID="cri-o://b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f" gracePeriod=30
May 29 13:45:14.844027 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.844005    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:45:14.972115 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972089    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972202 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972131    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972202 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972165    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972284 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972238    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972340 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972288    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972340 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972323    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.972411 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.972349    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsr5j\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.973659 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.973603    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:45:14.976631 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.976074    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca\") pod \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\" (UID: \"5b0f04c9-80d3-4a18-9900-f993d181cbaf\") "
May 29 13:45:14.976631 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.976410    2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-certificates\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:14.977037 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.977001    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:45:14.978126 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.978081    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j" (OuterVolumeSpecName: "kube-api-access-gsr5j") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "kube-api-access-gsr5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:45:14.978407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.978348    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:45:14.978407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.978396    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:45:14.980101 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.979754    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:45:14.980384 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.980348    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:45:14.989519 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:14.989385    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5b0f04c9-80d3-4a18-9900-f993d181cbaf" (UID: "5b0f04c9-80d3-4a18-9900-f993d181cbaf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:45:15.077618 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077594    2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-registry-tls\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077618 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077618    2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-image-registry-private-configuration\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077894 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077629    2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5b0f04c9-80d3-4a18-9900-f993d181cbaf-installation-pull-secrets\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077894 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077641    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsr5j\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-kube-api-access-gsr5j\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077894 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077650    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5b0f04c9-80d3-4a18-9900-f993d181cbaf-trusted-ca\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077894 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077658    2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5b0f04c9-80d3-4a18-9900-f993d181cbaf-ca-trust-extracted\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.077894 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.077666    2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5b0f04c9-80d3-4a18-9900-f993d181cbaf-bound-sa-token\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:45:15.640006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.639970    2549 generic.go:358] "Generic (PLEG): container finished" podID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerID="b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f" exitCode=0
May 29 13:45:15.640184 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.640042    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5755656bb6-bzddn"
May 29 13:45:15.640184 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.640063    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" event={"ID":"5b0f04c9-80d3-4a18-9900-f993d181cbaf","Type":"ContainerDied","Data":"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"}
May 29 13:45:15.640184 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.640110    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5755656bb6-bzddn" event={"ID":"5b0f04c9-80d3-4a18-9900-f993d181cbaf","Type":"ContainerDied","Data":"81c38c0a757b6774bc6cb7f6e0d8639ea721406c3f44925ed44b0814a8c676d7"}
May 29 13:45:15.640184 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.640132    2549 scope.go:117] "RemoveContainer" containerID="b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644021    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"4986d4fd4a03d27ac8258e469cc9702ad6b35f941009b79c18257f5357736bd7"}
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644050    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"e1bb15987a93ee3474027880f96a5d37429633386d96006fdb1d42210d118be8"}
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644065    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"618d9f4c6717ab5f3fed0fca8d1ffc19698a18be30472a5435fa1d6ad7f1f689"}
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644078    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"5a112b408123ec32e40bc4c624c4fa48a1b2147bb0dbb8f7b004cd557ade4e3a"}
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644090    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"f76cc72c259d6ed41f5e40fc6ec769dd361f1993fac607f9e71860131725785c"}
May 29 13:45:15.644117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.644101    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerStarted","Data":"0001f952e9ae368f873f67348e806c8f7b8713e846a73d113da691315431f164"}
May 29 13:45:15.650962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.650936    2549 scope.go:117] "RemoveContainer" containerID="b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"
May 29 13:45:15.651274 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:45:15.651236    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f\": container with ID starting with b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f not found: ID does not exist" containerID="b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"
May 29 13:45:15.651362 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.651292    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f"} err="failed to get container status \"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f\": rpc error: code = NotFound desc = could not find container \"b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f\": container with ID starting with b8d302c6f181e6a73f1b03651553b8c7ba9643bb1c20ce774db04403b456fd8f not found: ID does not exist"
May 29 13:45:15.676164 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.676119    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.53802336 podStartE2EDuration="5.676104879s" podCreationTimestamp="2026-05-29 13:45:10 +0000 UTC" firstStartedPulling="2026-05-29 13:45:11.617803413 +0000 UTC m=+162.100047872" lastFinishedPulling="2026-05-29 13:45:14.75588472 +0000 UTC m=+165.238129391" observedRunningTime="2026-05-29 13:45:15.674205971 +0000 UTC m=+166.156450449" watchObservedRunningTime="2026-05-29 13:45:15.676104879 +0000 UTC m=+166.158349356"
May 29 13:45:15.688346 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.688325    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:45:15.691884 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:15.691863    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5755656bb6-bzddn"]
May 29 13:45:16.109965 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:16.109931    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" path="/var/lib/kubelet/pods/5b0f04c9-80d3-4a18-9900-f993d181cbaf/volumes"
May 29 13:45:16.627430 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:16.627404    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86d85c69b4-75jzl"
May 29 13:45:18.102565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:18.102529    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:45:18.105627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:18.105600    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25vw9\""
May 29 13:45:18.113004 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:18.112980    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ql579"
May 29 13:45:18.260358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:18.260282    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ql579"]
May 29 13:45:20.620246 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:20.620130    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:45:22.102562 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:22.102527    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:45:23.637414 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:23.637385    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hrkf"
May 29 13:45:24.952104 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:45:24.952070    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d0cd67_e3f9_4d13_867c_e87844047b23.slice/crio-2ead116393ba3961172a0e906b01414923b0c79d156bcc4d3a8d04d0dd2b28c7 WatchSource:0}: Error finding container 2ead116393ba3961172a0e906b01414923b0c79d156bcc4d3a8d04d0dd2b28c7: Status 404 returned error can't find the container with id 2ead116393ba3961172a0e906b01414923b0c79d156bcc4d3a8d04d0dd2b28c7
May 29 13:45:25.680566 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:25.680503    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ql579" event={"ID":"f9d0cd67-e3f9-4d13-867c-e87844047b23","Type":"ContainerStarted","Data":"2ead116393ba3961172a0e906b01414923b0c79d156bcc4d3a8d04d0dd2b28c7"}
May 29 13:45:25.682395 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:25.682350    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-dzdnm" event={"ID":"d658f228-bc05-415e-9c0b-601b030dbdef","Type":"ContainerStarted","Data":"1760388b95223d5e1724c0ae5810781d2477bfb282d180485401d9ea42e660e7"}
May 29 13:45:25.682819 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:25.682794    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:25.696114 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:25.696088    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-dzdnm"
May 29 13:45:25.704387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:25.704307    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-dzdnm" podStartSLOduration=2.120467265 podStartE2EDuration="19.704290826s" podCreationTimestamp="2026-05-29 13:45:06 +0000 UTC" firstStartedPulling="2026-05-29 13:45:07.456156032 +0000 UTC m=+157.938400494" lastFinishedPulling="2026-05-29 13:45:25.039979587 +0000 UTC m=+175.522224055" observedRunningTime="2026-05-29 13:45:25.703763309 +0000 UTC m=+176.186007790" watchObservedRunningTime="2026-05-29 13:45:25.704290826 +0000 UTC m=+176.186535348"
May 29 13:45:27.690084 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:27.690042    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ql579" event={"ID":"f9d0cd67-e3f9-4d13-867c-e87844047b23","Type":"ContainerStarted","Data":"a2d4801d0195f197c6e43f344ec725a6421536cb9947e864d9981a389f073c7d"}
May 29 13:45:27.709597 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:27.709548    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ql579" podStartSLOduration=142.483611533 podStartE2EDuration="2m24.709531606s" podCreationTimestamp="2026-05-29 13:43:03 +0000 UTC" firstStartedPulling="2026-05-29 13:45:24.954486639 +0000 UTC m=+175.436731095" lastFinishedPulling="2026-05-29 13:45:27.180406709 +0000 UTC m=+177.662651168" observedRunningTime="2026-05-29 13:45:27.708169559 +0000 UTC m=+178.190414041" watchObservedRunningTime="2026-05-29 13:45:27.709531606 +0000 UTC m=+178.191776085"
May 29 13:45:28.618636 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:28.618599    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:28.618817 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:28.618649    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:45.749233 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:45.749206    2549 generic.go:358] "Generic (PLEG): container finished" podID="5362786f-0b9b-4f04-8121-1939048ab401" containerID="ab81187b31ac7a60159b053f7e88d7e1013c02ad4c00954e5a23de6460e5299e" exitCode=0
May 29 13:45:45.749574 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:45.749287    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml" event={"ID":"5362786f-0b9b-4f04-8121-1939048ab401","Type":"ContainerDied","Data":"ab81187b31ac7a60159b053f7e88d7e1013c02ad4c00954e5a23de6460e5299e"}
May 29 13:45:45.749695 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:45.749679    2549 scope.go:117] "RemoveContainer" containerID="ab81187b31ac7a60159b053f7e88d7e1013c02ad4c00954e5a23de6460e5299e"
May 29 13:45:46.753984 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:46.753948    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-5ztml" event={"ID":"5362786f-0b9b-4f04-8121-1939048ab401","Type":"ContainerStarted","Data":"955802b8b7f6a4cfe9e8607b821fc29866119677b3c7f9efe892c84a0d1f9eea"}
May 29 13:45:48.624156 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:48.624123    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:48.627929 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:48.627893    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d68dbcdd9-8gjph"
May 29 13:45:51.770216 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:51.770182    2549 generic.go:358] "Generic (PLEG): container finished" podID="4d21fd2b-778c-40b7-bd26-d28c4bbd8b28" containerID="e32eae5dbb9cd32f7f2748ea0321d93722b1eff371f22173b1a99a1cca52e509" exitCode=0
May 29 13:45:51.770682 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:51.770250    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87" event={"ID":"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28","Type":"ContainerDied","Data":"e32eae5dbb9cd32f7f2748ea0321d93722b1eff371f22173b1a99a1cca52e509"}
May 29 13:45:51.770682 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:51.770600    2549 scope.go:117] "RemoveContainer" containerID="e32eae5dbb9cd32f7f2748ea0321d93722b1eff371f22173b1a99a1cca52e509"
May 29 13:45:52.775440 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:45:52.775407    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9vp87" event={"ID":"4d21fd2b-778c-40b7-bd26-d28c4bbd8b28","Type":"ContainerStarted","Data":"b9dbc971c118cf3eb00993b1bd27338b9c9aeb80408e726cc61195ba3daab958"}
May 29 13:46:10.620971 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:10.620941    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:10.695366 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:10.695332    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:10.844198 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:10.844167    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:24.371943 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.371905    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:24.372438 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372337    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="alertmanager" containerID="cri-o://d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe" gracePeriod=120
May 29 13:46:24.372502 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372411    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-metric" containerID="cri-o://35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7" gracePeriod=120
May 29 13:46:24.372556 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372476    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="config-reloader" containerID="cri-o://aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6" gracePeriod=120
May 29 13:46:24.372556 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372491    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy" containerID="cri-o://6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58" gracePeriod=120
May 29 13:46:24.372556 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372507    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="prom-label-proxy" containerID="cri-o://42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30" gracePeriod=120
May 29 13:46:24.372735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.372438    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-web" containerID="cri-o://33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb" gracePeriod=120
May 29 13:46:24.871796 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871761    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30" exitCode=0
May 29 13:46:24.871796 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871787    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58" exitCode=0
May 29 13:46:24.871796 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871794    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6" exitCode=0
May 29 13:46:24.871796 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871799    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe" exitCode=0
May 29 13:46:24.872051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871826    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"}
May 29 13:46:24.872051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871857    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"}
May 29 13:46:24.872051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871866    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"}
May 29 13:46:24.872051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:24.871876    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"}
May 29 13:46:25.608047 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.608024    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:25.776389 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776370    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776529 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776412    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776529 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776442    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpsnb\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776645 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776626    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776691 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776676    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776742 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776707    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776742 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776738    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776771    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776783    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:25.776843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776806    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776991 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776850    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776991 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776881    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776991 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776920    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.776991 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.776965    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy\") pod \"0158560b-7f86-4cad-b64a-39e6623836a9\" (UID: \"0158560b-7f86-4cad-b64a-39e6623836a9\") "
May 29 13:46:25.777418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.777239    2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.777418 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.777380    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:25.778012 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.777983    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:46:25.779642 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.779606    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb" (OuterVolumeSpecName: "kube-api-access-dpsnb") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "kube-api-access-dpsnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:46:25.780170 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780130    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:46:25.780303 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780174    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.780448 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780418    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.780448 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780440    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume" (OuterVolumeSpecName: "config-volume") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.780602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780559    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.780819 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.780802    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out" (OuterVolumeSpecName: "config-out") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:46:25.781344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.781320    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.783726 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.783702    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.790772 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.790753    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config" (OuterVolumeSpecName: "web-config") pod "0158560b-7f86-4cad-b64a-39e6623836a9" (UID: "0158560b-7f86-4cad-b64a-39e6623836a9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:25.877476 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877446    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7" exitCode=0
May 29 13:46:25.877476 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877476    2549 generic.go:358] "Generic (PLEG): container finished" podID="0158560b-7f86-4cad-b64a-39e6623836a9" containerID="33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb" exitCode=0
May 29 13:46:25.877619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877541    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"}
May 29 13:46:25.877619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877578    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:25.877619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877591    2549 scope.go:117] "RemoveContainer" containerID="42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877647    2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877666    2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-main-tls\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877681    2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-alertmanager-main-db\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877695    2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877580    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"}
May 29 13:46:25.877719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877711    2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-config-volume\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877727    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpsnb\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-kube-api-access-dpsnb\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877728    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0158560b-7f86-4cad-b64a-39e6623836a9","Type":"ContainerDied","Data":"2af7df9f38e08209ba305c06833946196d28cc248dcddd5a6bb334498663a6af"}
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877740    2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-cluster-tls-config\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877754    2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877767    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0158560b-7f86-4cad-b64a-39e6623836a9-metrics-client-ca\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877780    2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0158560b-7f86-4cad-b64a-39e6623836a9-tls-assets\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877793    2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0158560b-7f86-4cad-b64a-39e6623836a9-web-config\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.877962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.877805    2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0158560b-7f86-4cad-b64a-39e6623836a9-config-out\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:25.884787 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.884768    2549 scope.go:117] "RemoveContainer" containerID="35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"
May 29 13:46:25.891215 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.891181    2549 scope.go:117] "RemoveContainer" containerID="6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"
May 29 13:46:25.897848 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.897828    2549 scope.go:117] "RemoveContainer" containerID="33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"
May 29 13:46:25.902126 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.902107    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:25.904603 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.904576    2549 scope.go:117] "RemoveContainer" containerID="aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"
May 29 13:46:25.908220 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.908195    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:25.911033 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.911015    2549 scope.go:117] "RemoveContainer" containerID="d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"
May 29 13:46:25.917217 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.917202    2549 scope.go:117] "RemoveContainer" containerID="8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"
May 29 13:46:25.923162 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923149    2549 scope.go:117] "RemoveContainer" containerID="42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"
May 29 13:46:25.923424 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.923407    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30\": container with ID starting with 42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30 not found: ID does not exist" containerID="42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"
May 29 13:46:25.923479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923431    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"} err="failed to get container status \"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30\": rpc error: code = NotFound desc = could not find container \"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30\": container with ID starting with 42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30 not found: ID does not exist"
May 29 13:46:25.923479 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923451    2549 scope.go:117] "RemoveContainer" containerID="35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"
May 29 13:46:25.923645 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.923630    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7\": container with ID starting with 35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7 not found: ID does not exist" containerID="35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"
May 29 13:46:25.923684 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923649    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"} err="failed to get container status \"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7\": rpc error: code = NotFound desc = could not find container \"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7\": container with ID starting with 35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7 not found: ID does not exist"
May 29 13:46:25.923684 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923663    2549 scope.go:117] "RemoveContainer" containerID="6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"
May 29 13:46:25.923836 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.923819    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58\": container with ID starting with 6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58 not found: ID does not exist" containerID="6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"
May 29 13:46:25.923878 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923841    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"} err="failed to get container status \"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58\": rpc error: code = NotFound desc = could not find container \"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58\": container with ID starting with 6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58 not found: ID does not exist"
May 29 13:46:25.923878 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.923852    2549 scope.go:117] "RemoveContainer" containerID="33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"
May 29 13:46:25.924071 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.924054    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb\": container with ID starting with 33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb not found: ID does not exist" containerID="33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"
May 29 13:46:25.924117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924073    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"} err="failed to get container status \"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb\": rpc error: code = NotFound desc = could not find container \"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb\": container with ID starting with 33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb not found: ID does not exist"
May 29 13:46:25.924117 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924084    2549 scope.go:117] "RemoveContainer" containerID="aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"
May 29 13:46:25.924304 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.924287    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6\": container with ID starting with aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6 not found: ID does not exist" containerID="aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"
May 29 13:46:25.924358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924308    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"} err="failed to get container status \"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6\": rpc error: code = NotFound desc = could not find container \"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6\": container with ID starting with aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6 not found: ID does not exist"
May 29 13:46:25.924358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924321    2549 scope.go:117] "RemoveContainer" containerID="d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"
May 29 13:46:25.924525 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.924512    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe\": container with ID starting with d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe not found: ID does not exist" containerID="d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"
May 29 13:46:25.924565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924527    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"} err="failed to get container status \"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe\": rpc error: code = NotFound desc = could not find container \"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe\": container with ID starting with d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe not found: ID does not exist"
May 29 13:46:25.924565 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924540    2549 scope.go:117] "RemoveContainer" containerID="8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"
May 29 13:46:25.924722 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:46:25.924707    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009\": container with ID starting with 8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009 not found: ID does not exist" containerID="8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"
May 29 13:46:25.924758 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924724    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"} err="failed to get container status \"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009\": rpc error: code = NotFound desc = could not find container \"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009\": container with ID starting with 8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009 not found: ID does not exist"
May 29 13:46:25.924758 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924735    2549 scope.go:117] "RemoveContainer" containerID="42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"
May 29 13:46:25.924940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924923    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30"} err="failed to get container status \"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30\": rpc error: code = NotFound desc = could not find container \"42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30\": container with ID starting with 42263895ba88f48a6417fab56ecd94386e7486240fbc483370f4191933ad6c30 not found: ID does not exist"
May 29 13:46:25.924940 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.924939    2549 scope.go:117] "RemoveContainer" containerID="35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"
May 29 13:46:25.925109 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925094    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7"} err="failed to get container status \"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7\": rpc error: code = NotFound desc = could not find container \"35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7\": container with ID starting with 35f52656688ee655889ab3e25ab55f1e9191a73134acc9c4c528a0d341e7d0a7 not found: ID does not exist"
May 29 13:46:25.925109 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925107    2549 scope.go:117] "RemoveContainer" containerID="6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"
May 29 13:46:25.925305 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925285    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58"} err="failed to get container status \"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58\": rpc error: code = NotFound desc = could not find container \"6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58\": container with ID starting with 6d8b3591417fcfebfad2c4e69ec89fb7e5bab0a639051ce7a47483d120e9bf58 not found: ID does not exist"
May 29 13:46:25.925364 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925305    2549 scope.go:117] "RemoveContainer" containerID="33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"
May 29 13:46:25.925512 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925497    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb"} err="failed to get container status \"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb\": rpc error: code = NotFound desc = could not find container \"33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb\": container with ID starting with 33bd0f8353089fb075a507e365f3f0003108ba67c2ed77a8c41f1174df29bbeb not found: ID does not exist"
May 29 13:46:25.925512 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925511    2549 scope.go:117] "RemoveContainer" containerID="aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"
May 29 13:46:25.925678 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925665    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6"} err="failed to get container status \"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6\": rpc error: code = NotFound desc = could not find container \"aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6\": container with ID starting with aaf711251e7b8ad870c9f8ef8a95ee8b9d90e3f355f885d2724ae91c546d6ff6 not found: ID does not exist"
May 29 13:46:25.925722 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925677    2549 scope.go:117] "RemoveContainer" containerID="d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"
May 29 13:46:25.925837 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925824    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe"} err="failed to get container status \"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe\": rpc error: code = NotFound desc = could not find container \"d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe\": container with ID starting with d64e70b996e75e4bad090408e47a649bee33db58c397fe6c72a20ef654f047fe not found: ID does not exist"
May 29 13:46:25.925885 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.925836    2549 scope.go:117] "RemoveContainer" containerID="8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"
May 29 13:46:25.926018 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.926003    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009"} err="failed to get container status \"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009\": rpc error: code = NotFound desc = could not find container \"8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009\": container with ID starting with 8b399996f710bf70b1282d1801a32453f2b0e8236e4ac4fa5221c6c9bd935009 not found: ID does not exist"
May 29 13:46:25.937949 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.937925    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:25.938242 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938230    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy"
May 29 13:46:25.938304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938244    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy"
May 29 13:46:25.938304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938252    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="prom-label-proxy"
May 29 13:46:25.938304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938277    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="prom-label-proxy"
May 29 13:46:25.938304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938297    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-metric"
May 29 13:46:25.938304 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938303    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-metric"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938311    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerName="registry"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938316    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerName="registry"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938321    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="alertmanager"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938326    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="alertmanager"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938332    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-web"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938336    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-web"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938344    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="config-reloader"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938349    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="config-reloader"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938355    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="init-config-reloader"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938359    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="init-config-reloader"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938407    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b0f04c9-80d3-4a18-9900-f993d181cbaf" containerName="registry"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938413    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938422    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-web"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938428    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="kube-rbac-proxy-metric"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938434    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="prom-label-proxy"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938441    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="alertmanager"
May 29 13:46:25.938490 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.938448    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" containerName="config-reloader"
May 29 13:46:25.942195 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.942181    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:25.944709 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.944693    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 13:46:25.944914 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.944899    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 13:46:25.944974 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.944904    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8wpgd\""
May 29 13:46:25.945030 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.944978    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 13:46:25.945162 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.945134    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 13:46:25.945162 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.945134    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 13:46:25.945332 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.945156    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 13:46:25.945398 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.945382    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 13:46:25.945855 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.945842    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 13:46:25.951608 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.951591    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 13:46:25.958686 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:25.958666    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:26.080106 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080029    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-config-volume\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080106 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080070    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080106 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080092    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmk4v\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-kube-api-access-xmk4v\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080157    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080193    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080218    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080238    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080339 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080329    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080487 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080347    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080487 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080361    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080487 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080379    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-config-out\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080487 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080396    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-web-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.080487 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.080455    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.106051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.106017    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0158560b-7f86-4cad-b64a-39e6623836a9" path="/var/lib/kubelet/pods/0158560b-7f86-4cad-b64a-39e6623836a9/volumes"
May 29 13:46:26.180856 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.180812    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.180856 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.180861    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmk4v\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-kube-api-access-xmk4v\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181075 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.180991    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181075 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181057    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181178 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181115    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181178 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181146    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181315 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181235    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181315 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181293    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181323    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181356    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-config-out\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181389    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-web-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181423    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181456    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-config-volume\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.181866 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.181840    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.182034 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.182007    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.183931    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.183946    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184061    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184335 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184136    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184335 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184214    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8358f806-ad84-444a-bf44-cf50550e1101-config-out\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184335 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184321    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184320    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-config-volume\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184631 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184610    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8358f806-ad84-444a-bf44-cf50550e1101-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.184662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.184652    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-web-config\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.185753 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.185734    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8358f806-ad84-444a-bf44-cf50550e1101-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.191027 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.191010    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmk4v\" (UniqueName: \"kubernetes.io/projected/8358f806-ad84-444a-bf44-cf50550e1101-kube-api-access-xmk4v\") pod \"alertmanager-main-0\" (UID: \"8358f806-ad84-444a-bf44-cf50550e1101\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.252087 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.252059    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 13:46:26.386087 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.386012    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 13:46:26.390678 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:46:26.390650    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8358f806_ad84_444a_bf44_cf50550e1101.slice/crio-676a2c989e6ca36e17309f3016eb6c2737589fbef8d02d34146ff797996df61e WatchSource:0}: Error finding container 676a2c989e6ca36e17309f3016eb6c2737589fbef8d02d34146ff797996df61e: Status 404 returned error can't find the container with id 676a2c989e6ca36e17309f3016eb6c2737589fbef8d02d34146ff797996df61e
May 29 13:46:26.881406 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.881379    2549 generic.go:358] "Generic (PLEG): container finished" podID="8358f806-ad84-444a-bf44-cf50550e1101" containerID="37c40e1f6317ee6cfab5a39634966dd24a736ea42e20a4be1d1b4883412d7c22" exitCode=0
May 29 13:46:26.881814 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.881464    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerDied","Data":"37c40e1f6317ee6cfab5a39634966dd24a736ea42e20a4be1d1b4883412d7c22"}
May 29 13:46:26.881814 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:26.881496    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"676a2c989e6ca36e17309f3016eb6c2737589fbef8d02d34146ff797996df61e"}
May 29 13:46:27.888202 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888165    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"25bab52aecb4e680193f257b504e1589f0eb38db417df7598b1d4e3475073376"}
May 29 13:46:27.888584 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888211    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"e9f47c646a123fc91ca40f6ccf980b3e35c5fdb998f655d1a6a6810cf63d4f71"}
May 29 13:46:27.888584 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888229    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"c5c02656d42fc749b6372c119da6219b891c616fcac89c31c9de6953849318d9"}
May 29 13:46:27.888584 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888242    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"8e92072c29e811347feb4698ff66ce803d4d9f6776f4d6baf997397515331cf2"}
May 29 13:46:27.888584 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888256    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"3cce2eef245a666f6f91433b2db817fa1aec4dbc4cad003dc4dc6629d161b1d9"}
May 29 13:46:27.888584 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.888292    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8358f806-ad84-444a-bf44-cf50550e1101","Type":"ContainerStarted","Data":"a4152115ba4363d653a041a973f33e65541a8dfb100d134527a90122dd0be608"}
May 29 13:46:27.917344 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:27.917297    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.917282677 podStartE2EDuration="2.917282677s" podCreationTimestamp="2026-05-29 13:46:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:46:27.91642272 +0000 UTC m=+238.398667198" watchObservedRunningTime="2026-05-29 13:46:27.917282677 +0000 UTC m=+238.399527154"
May 29 13:46:28.431731 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.431696    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"]
May 29 13:46:28.434346 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.434328    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.437039 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.437013    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 29 13:46:28.437322 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.437295    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 29 13:46:28.437433 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.437358    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 29 13:46:28.438002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.437905    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 29 13:46:28.438002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.437929    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 29 13:46:28.438167 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.438080    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tkkhs\""
May 29 13:46:28.443541 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.443522    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 29 13:46:28.449923 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.449900    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"]
May 29 13:46:28.603893 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.603865    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-serving-certs-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604059 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.603898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-federate-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604059 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.603992    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604059 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.604029    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604174 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.604059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqcsw\" (UniqueName: \"kubernetes.io/projected/da27dda2-1a81-4715-83ec-77710befafc4-kube-api-access-cqcsw\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604174 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.604102    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-metrics-client-ca\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604174 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.604130    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.604174 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.604149    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.704662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.704601    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-serving-certs-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.704662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.704629    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-federate-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.704825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.704762    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.704825 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.704803    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705052 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705025    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqcsw\" (UniqueName: \"kubernetes.io/projected/da27dda2-1a81-4715-83ec-77710befafc4-kube-api-access-cqcsw\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705176 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705083    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-metrics-client-ca\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705176 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705131    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705176 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705155    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705432 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705384    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-serving-certs-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705739 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705707    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.705840 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.705779    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da27dda2-1a81-4715-83ec-77710befafc4-metrics-client-ca\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.707214 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.707194    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-federate-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.707680 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.707651    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.707754 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.707691    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.707754 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.707701    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da27dda2-1a81-4715-83ec-77710befafc4-telemeter-client-tls\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.716484 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.716466    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqcsw\" (UniqueName: \"kubernetes.io/projected/da27dda2-1a81-4715-83ec-77710befafc4-kube-api-access-cqcsw\") pod \"telemeter-client-5c74858cf9-g6g4f\" (UID: \"da27dda2-1a81-4715-83ec-77710befafc4\") " pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.724451 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724428    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:28.724932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724848    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="config-reloader" containerID="cri-o://f76cc72c259d6ed41f5e40fc6ec769dd361f1993fac607f9e71860131725785c" gracePeriod=600
May 29 13:46:28.724932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724868    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="prometheus" containerID="cri-o://0001f952e9ae368f873f67348e806c8f7b8713e846a73d113da691315431f164" gracePeriod=600
May 29 13:46:28.724932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724875    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4986d4fd4a03d27ac8258e469cc9702ad6b35f941009b79c18257f5357736bd7" gracePeriod=600
May 29 13:46:28.724932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724876    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-web" containerID="cri-o://618d9f4c6717ab5f3fed0fca8d1ffc19698a18be30472a5435fa1d6ad7f1f689" gracePeriod=600
May 29 13:46:28.724932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724851    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="thanos-sidecar" containerID="cri-o://5a112b408123ec32e40bc4c624c4fa48a1b2147bb0dbb8f7b004cd557ade4e3a" gracePeriod=600
May 29 13:46:28.725162 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.724844    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy" containerID="cri-o://e1bb15987a93ee3474027880f96a5d37429633386d96006fdb1d42210d118be8" gracePeriod=600
May 29 13:46:28.746226 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.746205    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"
May 29 13:46:28.882313 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.882290    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c74858cf9-g6g4f"]
May 29 13:46:28.884159 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:46:28.884135    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda27dda2_1a81_4715_83ec_77710befafc4.slice/crio-b38740e03d7238343db1f40e6eabeddff9e0c66889a5c83508c730770c75f3b1 WatchSource:0}: Error finding container b38740e03d7238343db1f40e6eabeddff9e0c66889a5c83508c730770c75f3b1: Status 404 returned error can't find the container with id b38740e03d7238343db1f40e6eabeddff9e0c66889a5c83508c730770c75f3b1
May 29 13:46:28.894368 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894346    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="4986d4fd4a03d27ac8258e469cc9702ad6b35f941009b79c18257f5357736bd7" exitCode=0
May 29 13:46:28.894368 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894367    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="e1bb15987a93ee3474027880f96a5d37429633386d96006fdb1d42210d118be8" exitCode=0
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894374    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="618d9f4c6717ab5f3fed0fca8d1ffc19698a18be30472a5435fa1d6ad7f1f689" exitCode=0
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894379    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="5a112b408123ec32e40bc4c624c4fa48a1b2147bb0dbb8f7b004cd557ade4e3a" exitCode=0
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894385    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="f76cc72c259d6ed41f5e40fc6ec769dd361f1993fac607f9e71860131725785c" exitCode=0
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894390    2549 generic.go:358] "Generic (PLEG): container finished" podID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerID="0001f952e9ae368f873f67348e806c8f7b8713e846a73d113da691315431f164" exitCode=0
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894417    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"4986d4fd4a03d27ac8258e469cc9702ad6b35f941009b79c18257f5357736bd7"}
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894451    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"e1bb15987a93ee3474027880f96a5d37429633386d96006fdb1d42210d118be8"}
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894463    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"618d9f4c6717ab5f3fed0fca8d1ffc19698a18be30472a5435fa1d6ad7f1f689"}
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894476    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"5a112b408123ec32e40bc4c624c4fa48a1b2147bb0dbb8f7b004cd557ade4e3a"}
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894484    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"f76cc72c259d6ed41f5e40fc6ec769dd361f1993fac607f9e71860131725785c"}
May 29 13:46:28.894757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.894492    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"0001f952e9ae368f873f67348e806c8f7b8713e846a73d113da691315431f164"}
May 29 13:46:28.895553 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.895531    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f" event={"ID":"da27dda2-1a81-4715-83ec-77710befafc4","Type":"ContainerStarted","Data":"b38740e03d7238343db1f40e6eabeddff9e0c66889a5c83508c730770c75f3b1"}
May 29 13:46:28.968292 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:28.968255    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:29.108681 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108651    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108681 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108682    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108844 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108705    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108844 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108733    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx8nk\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108844 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108759    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108844 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108788    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.108844 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108818    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108846    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108876    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108900    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108924    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108957    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.108990    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109030    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109077    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109081    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:29.109099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109090    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:29.109641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109120    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109167    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109195    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca\") pod \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\" (UID: \"dac57da8-a23b-4f39-bdc9-26d745ab8efb\") "
May 29 13:46:29.109790 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109645    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:29.109790 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109746    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.109790 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109766    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.109790 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.109784    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.111602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.111277    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.111948    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112055    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112209    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112291    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112332    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112344    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112449 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112378    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config" (OuterVolumeSpecName: "config") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.112887 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112502    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk" (OuterVolumeSpecName: "kube-api-access-dx8nk") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "kube-api-access-dx8nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:46:29.113009 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.112983    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 13:46:29.113300 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.113253    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.113570 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.113552    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out" (OuterVolumeSpecName: "config-out") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:46:29.113963 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.113946    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:46:29.113963 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.113953    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.122962 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.122938    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config" (OuterVolumeSpecName: "web-config") pod "dac57da8-a23b-4f39-bdc9-26d745ab8efb" (UID: "dac57da8-a23b-4f39-bdc9-26d745ab8efb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 13:46:29.210580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210553    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210577    2549 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-prometheus-k8s-db\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210593    2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-web-config\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210606    2549 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dac57da8-a23b-4f39-bdc9-26d745ab8efb-configmap-metrics-client-ca\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210621    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210635    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx8nk\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-kube-api-access-dx8nk\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210648    2549 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-grpc-tls\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210662    2549 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-kube-rbac-proxy\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210675    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210689    2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config-out\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210702    2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dac57da8-a23b-4f39-bdc9-26d745ab8efb-tls-assets\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210716    2549 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.210735 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210729    2549 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-config\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.211084 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210743    2549 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.211084 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.210756    2549 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dac57da8-a23b-4f39-bdc9-26d745ab8efb-secret-metrics-client-certs\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:46:29.902199 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.902163    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dac57da8-a23b-4f39-bdc9-26d745ab8efb","Type":"ContainerDied","Data":"1b2476b7e57eed38f3a571a9e166a7ff853ddced55d8fe2fe63fc186dde276e7"}
May 29 13:46:29.902602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.902217    2549 scope.go:117] "RemoveContainer" containerID="4986d4fd4a03d27ac8258e469cc9702ad6b35f941009b79c18257f5357736bd7"
May 29 13:46:29.902602 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.902301    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:29.911168 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.911142    2549 scope.go:117] "RemoveContainer" containerID="e1bb15987a93ee3474027880f96a5d37429633386d96006fdb1d42210d118be8"
May 29 13:46:29.919274 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.919238    2549 scope.go:117] "RemoveContainer" containerID="618d9f4c6717ab5f3fed0fca8d1ffc19698a18be30472a5435fa1d6ad7f1f689"
May 29 13:46:29.926383 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.926365    2549 scope.go:117] "RemoveContainer" containerID="5a112b408123ec32e40bc4c624c4fa48a1b2147bb0dbb8f7b004cd557ade4e3a"
May 29 13:46:29.929918 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.929899    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:29.933066 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.933051    2549 scope.go:117] "RemoveContainer" containerID="f76cc72c259d6ed41f5e40fc6ec769dd361f1993fac607f9e71860131725785c"
May 29 13:46:29.936358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.936339    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:29.939708 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.939689    2549 scope.go:117] "RemoveContainer" containerID="0001f952e9ae368f873f67348e806c8f7b8713e846a73d113da691315431f164"
May 29 13:46:29.946069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.946051    2549 scope.go:117] "RemoveContainer" containerID="fddefd31f05b6e6f1e247099ac0db4d756cf77f8c733f6e5510806127c33dcae"
May 29 13:46:29.964426 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964380    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:29.964715 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964703    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="config-reloader"
May 29 13:46:29.964757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964717    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="config-reloader"
May 29 13:46:29.964757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964732    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-thanos"
May 29 13:46:29.964757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964739    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-thanos"
May 29 13:46:29.964757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964749    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="thanos-sidecar"
May 29 13:46:29.964757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964755    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="thanos-sidecar"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964761    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-web"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964766    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-web"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964772    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964777    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964788    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="init-config-reloader"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964793    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="init-config-reloader"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964799    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="prometheus"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964804    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="prometheus"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964854    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-thanos"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964864    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="config-reloader"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964871    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="prometheus"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964877    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="thanos-sidecar"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964883    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy-web"
May 29 13:46:29.964899 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.964888    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" containerName="kube-rbac-proxy"
May 29 13:46:29.968478 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.968463    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:29.970906 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.970890    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 29 13:46:29.971870 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.971853    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 29 13:46:29.972932 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.972837    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 29 13:46:29.973098 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.972938    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 29 13:46:29.973098 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.972993    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 29 13:46:29.973098 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.972999    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 29 13:46:29.973283 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973240    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 29 13:46:29.973367 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973351    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 29 13:46:29.973567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973553    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 29 13:46:29.973627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973613    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-48bsm\""
May 29 13:46:29.973741 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973724    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3ealrve0m9qpv\""
May 29 13:46:29.973795 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.973738    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 29 13:46:29.978369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.978220    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 29 13:46:29.980632 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.980611    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 29 13:46:29.984006 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:29.983989    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:30.105361 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.105331    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac57da8-a23b-4f39-bdc9-26d745ab8efb" path="/var/lib/kubelet/pods/dac57da8-a23b-4f39-bdc9-26d745ab8efb/volumes"
May 29 13:46:30.118609 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118588    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118724 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118616    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118724 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118633    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84blc\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-kube-api-access-84blc\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118724 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118696    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118830 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118722    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118830 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118763    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118830 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118788    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118830 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118814    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118846    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118881    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118919    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.118954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118943    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118960    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.118988    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.119055    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.119095    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.119128    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.119319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.119159    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220181    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220222    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220237    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84blc\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-kube-api-access-84blc\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220288    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220311    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220336    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220362    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220428    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220517 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220477    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220522    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220556    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220592    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220631    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220686    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.220765 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.220729    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.221253 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.221219    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.221972 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.221646    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.221972 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.221862    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.222448 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.222422    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.223935 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.223915    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224038 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.223964    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224038 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.223995    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224038 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.224026    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224038 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.224028    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224245 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.224103    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.224369 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.224342    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.226310 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.226286    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.226400 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.226335    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.227001 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.226616    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.227001 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.226946    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.227148 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.227097    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.227148 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.227120    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.227945 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.227921    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.228074 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.228039    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.228813 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.228787    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.229614 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.229592    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84blc\" (UniqueName: \"kubernetes.io/projected/f5faa883-2caf-4ce1-9b4c-842a64be9fa1-kube-api-access-84blc\") pod \"prometheus-k8s-0\" (UID: \"f5faa883-2caf-4ce1-9b4c-842a64be9fa1\") " pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.281521 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.281496    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:30.448977 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.448930    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 29 13:46:30.811009 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:46:30.810967    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5faa883_2caf_4ce1_9b4c_842a64be9fa1.slice/crio-8034925a526c9887bca10ca49d1b04368f25f2f059bb21f3cb916369debaf0ca WatchSource:0}: Error finding container 8034925a526c9887bca10ca49d1b04368f25f2f059bb21f3cb916369debaf0ca: Status 404 returned error can't find the container with id 8034925a526c9887bca10ca49d1b04368f25f2f059bb21f3cb916369debaf0ca
May 29 13:46:30.907805 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.907778    2549 generic.go:358] "Generic (PLEG): container finished" podID="f5faa883-2caf-4ce1-9b4c-842a64be9fa1" containerID="5d152272c7d376f7c4b21467dc18984a174f34ffd693b54c8bbe6fbeeff7dde7" exitCode=0
May 29 13:46:30.908130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.907853    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerDied","Data":"5d152272c7d376f7c4b21467dc18984a174f34ffd693b54c8bbe6fbeeff7dde7"}
May 29 13:46:30.908130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:30.907886    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"8034925a526c9887bca10ca49d1b04368f25f2f059bb21f3cb916369debaf0ca"}
May 29 13:46:31.912911 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.912874    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f" event={"ID":"da27dda2-1a81-4715-83ec-77710befafc4","Type":"ContainerStarted","Data":"82b3ab74d1a76dd1cca514633002688156a92cf91da0337f0e3abde525e5d431"}
May 29 13:46:31.913307 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.912918    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f" event={"ID":"da27dda2-1a81-4715-83ec-77710befafc4","Type":"ContainerStarted","Data":"e2020989654d6c12829871090338ae27641e6d567618f68e1fca5a2a7dad88dc"}
May 29 13:46:31.913307 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.912934    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f" event={"ID":"da27dda2-1a81-4715-83ec-77710befafc4","Type":"ContainerStarted","Data":"d7025911696b3d93dae337099cdf16016317fa22124b8dc5599ac37e56ddb917"}
May 29 13:46:31.915557 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915528    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"4d524509efea4d421e0e98800e7ad4a5b2164b141b867627da053f12f474efdc"}
May 29 13:46:31.915661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915575    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"72b3facfe3227344f84a72e80d6e68178f3058fb850c4571eedb0f2aabfa6a0e"}
May 29 13:46:31.915661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915590    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"7d12539f680349b3540f0deb782abdca30181829f945fb2b9fe3daa7ab1201ad"}
May 29 13:46:31.915661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915603    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"c8c036562ecd0483d0e5bf0de5ba4defbf196b2b9e0b8dd7388d6258b5caa1ea"}
May 29 13:46:31.915661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915614    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"df128db655ac59d514a362ec1ed3c11756fe27fc1b12df64748990ad3734fe68"}
May 29 13:46:31.915661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.915625    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5faa883-2caf-4ce1-9b4c-842a64be9fa1","Type":"ContainerStarted","Data":"31a397d430ef9747512afea07e71ecd5475b7244bf6740cac896b55eda7879ee"}
May 29 13:46:31.938192 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.938155    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c74858cf9-g6g4f" podStartSLOduration=1.975515885 podStartE2EDuration="3.938143327s" podCreationTimestamp="2026-05-29 13:46:28 +0000 UTC" firstStartedPulling="2026-05-29 13:46:28.885957408 +0000 UTC m=+239.368201867" lastFinishedPulling="2026-05-29 13:46:30.848584852 +0000 UTC m=+241.330829309" observedRunningTime="2026-05-29 13:46:31.936443446 +0000 UTC m=+242.418687922" watchObservedRunningTime="2026-05-29 13:46:31.938143327 +0000 UTC m=+242.420387803"
May 29 13:46:31.967396 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:31.967358    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.96734618 podStartE2EDuration="2.96734618s" podCreationTimestamp="2026-05-29 13:46:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:46:31.965032453 +0000 UTC m=+242.447276942" watchObservedRunningTime="2026-05-29 13:46:31.96734618 +0000 UTC m=+242.449590657"
May 29 13:46:35.282443 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:35.282396    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:46:41.823439 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:41.823404    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:46:41.825637 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:41.825618    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1879625a-c0e3-45ef-a577-3261d2afd611-metrics-certs\") pod \"network-metrics-daemon-6dspt\" (UID: \"1879625a-c0e3-45ef-a577-3261d2afd611\") " pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:46:41.905687 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:41.905660    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-km4z9\""
May 29 13:46:41.914048 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:41.914033    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6dspt"
May 29 13:46:42.035204 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:42.035181    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6dspt"]
May 29 13:46:42.037568 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:46:42.037541    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1879625a_c0e3_45ef_a577_3261d2afd611.slice/crio-3d220afa8a653b94e25afbf958a08abb0b2d455c63b633aaf1f9e5ad3a51435b WatchSource:0}: Error finding container 3d220afa8a653b94e25afbf958a08abb0b2d455c63b633aaf1f9e5ad3a51435b: Status 404 returned error can't find the container with id 3d220afa8a653b94e25afbf958a08abb0b2d455c63b633aaf1f9e5ad3a51435b
May 29 13:46:42.950485 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:42.950451    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dspt" event={"ID":"1879625a-c0e3-45ef-a577-3261d2afd611","Type":"ContainerStarted","Data":"3d220afa8a653b94e25afbf958a08abb0b2d455c63b633aaf1f9e5ad3a51435b"}
May 29 13:46:43.954995 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:43.954956    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dspt" event={"ID":"1879625a-c0e3-45ef-a577-3261d2afd611","Type":"ContainerStarted","Data":"ac5562c9c817f221af93d1f77ff405606a9a3382137e4330822a897641ef0ca0"}
May 29 13:46:43.954995 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:43.954995    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6dspt" event={"ID":"1879625a-c0e3-45ef-a577-3261d2afd611","Type":"ContainerStarted","Data":"3a509274eff286d7f018b6fe7a096b427040f03708d57dfa05943d07aa5fc658"}
May 29 13:46:43.973551 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:46:43.973504    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6dspt" podStartSLOduration=252.807037139 podStartE2EDuration="4m13.973488002s" podCreationTimestamp="2026-05-29 13:42:30 +0000 UTC" firstStartedPulling="2026-05-29 13:46:42.039354718 +0000 UTC m=+252.521599173" lastFinishedPulling="2026-05-29 13:46:43.205805578 +0000 UTC m=+253.688050036" observedRunningTime="2026-05-29 13:46:43.971379545 +0000 UTC m=+254.453624029" watchObservedRunningTime="2026-05-29 13:46:43.973488002 +0000 UTC m=+254.455732479"
May 29 13:47:29.982009 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:29.981978    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:47:29.983966 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:29.983936    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:47:29.987616 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:29.987599    2549 kubelet.go:1628] "Image garbage collection succeeded"
May 29 13:47:30.282120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:30.282090    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:47:30.297426 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:30.297403    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:47:31.101191 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:47:31.101160    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 29 13:48:08.458605 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.458571    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ww9cs"]
May 29 13:48:08.461004 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.460987    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.463540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.463520    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 13:48:08.471359 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.471338    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ww9cs"]
May 29 13:48:08.599422 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.599396    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-dbus\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.599540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.599436    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-kubelet-config\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.599540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.599471    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-original-pull-secret\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.700368 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.700331    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-dbus\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.700368 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.700377    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-kubelet-config\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.700549 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.700409    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-original-pull-secret\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.700549 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.700504    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-dbus\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.700549 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.700529    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-kubelet-config\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.702591 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.702575    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0-original-pull-secret\") pod \"global-pull-secret-syncer-ww9cs\" (UID: \"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0\") " pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.770085 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.770031    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ww9cs"
May 29 13:48:08.895957 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.895931    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ww9cs"]
May 29 13:48:08.898509 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:48:08.898472    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb502ed_dfcb_4a9b_b2d5_2e1b4f8d30d0.slice/crio-e01b5f0860a3fbab82e5ed819f148077b36ce8034e9158d2b7a51448bdf14722 WatchSource:0}: Error finding container e01b5f0860a3fbab82e5ed819f148077b36ce8034e9158d2b7a51448bdf14722: Status 404 returned error can't find the container with id e01b5f0860a3fbab82e5ed819f148077b36ce8034e9158d2b7a51448bdf14722
May 29 13:48:08.899979 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:08.899963    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 13:48:09.210692 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:09.210666    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ww9cs" event={"ID":"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0","Type":"ContainerStarted","Data":"e01b5f0860a3fbab82e5ed819f148077b36ce8034e9158d2b7a51448bdf14722"}
May 29 13:48:13.225648 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:13.225620    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ww9cs" event={"ID":"1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0","Type":"ContainerStarted","Data":"f977479314708d01520e414707a1d3b7fe7ba3ad92d27acd31a092aa452e138c"}
May 29 13:48:13.242887 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:48:13.242837    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ww9cs" podStartSLOduration=1.7924463579999999 podStartE2EDuration="5.24281978s" podCreationTimestamp="2026-05-29 13:48:08 +0000 UTC" firstStartedPulling="2026-05-29 13:48:08.900085125 +0000 UTC m=+339.382329580" lastFinishedPulling="2026-05-29 13:48:12.350458547 +0000 UTC m=+342.832703002" observedRunningTime="2026-05-29 13:48:13.241903086 +0000 UTC m=+343.724147564" watchObservedRunningTime="2026-05-29 13:48:13.24281978 +0000 UTC m=+343.725064258"
May 29 13:49:09.028876 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.028839    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ft75j"]
May 29 13:49:09.031194 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.031177    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.034018 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.033994    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 29 13:49:09.034142 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.033995    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 29 13:49:09.034142 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.033999    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-g7hd7\""
May 29 13:49:09.040237 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.040216    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ft75j"]
May 29 13:49:09.143532 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.143509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.143743 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.143717    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qx5\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-kube-api-access-p6qx5\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.244626 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.244603    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.244743 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.244654    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qx5\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-kube-api-access-p6qx5\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.253657 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.253622    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.253760 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.253730    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qx5\" (UniqueName: \"kubernetes.io/projected/64d43ba4-ba5d-49b9-bf98-c5c1bb047f92-kube-api-access-p6qx5\") pod \"cert-manager-cainjector-68b757865b-ft75j\" (UID: \"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92\") " pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.349216 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.349163    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j"
May 29 13:49:09.471408 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:09.471379    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-ft75j"]
May 29 13:49:09.475233 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:49:09.475206    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64d43ba4_ba5d_49b9_bf98_c5c1bb047f92.slice/crio-9562841479eb3932b369ecfad8d8f028c68247b8d6b0ee3f74628868bb5f5344 WatchSource:0}: Error finding container 9562841479eb3932b369ecfad8d8f028c68247b8d6b0ee3f74628868bb5f5344: Status 404 returned error can't find the container with id 9562841479eb3932b369ecfad8d8f028c68247b8d6b0ee3f74628868bb5f5344
May 29 13:49:10.404587 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:10.404550    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j" event={"ID":"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92","Type":"ContainerStarted","Data":"9562841479eb3932b369ecfad8d8f028c68247b8d6b0ee3f74628868bb5f5344"}
May 29 13:49:12.413040 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:12.413010    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j" event={"ID":"64d43ba4-ba5d-49b9-bf98-c5c1bb047f92","Type":"ContainerStarted","Data":"b08071b14a6b3d20a2394e478b96b2e7e39bf7485979aeff6d59155dcf4265c0"}
May 29 13:49:12.439843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:12.439799    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-ft75j" podStartSLOduration=0.692501872 podStartE2EDuration="3.439785978s" podCreationTimestamp="2026-05-29 13:49:09 +0000 UTC" firstStartedPulling="2026-05-29 13:49:09.477562836 +0000 UTC m=+399.959807292" lastFinishedPulling="2026-05-29 13:49:12.224846939 +0000 UTC m=+402.707091398" observedRunningTime="2026-05-29 13:49:12.437799921 +0000 UTC m=+402.920044400" watchObservedRunningTime="2026-05-29 13:49:12.439785978 +0000 UTC m=+402.922030455"
May 29 13:49:41.443437 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.443399    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"]
May 29 13:49:41.448072 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.448051    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.451159 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.451138    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 29 13:49:41.451425 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.451409    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 29 13:49:41.451695 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.451679    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zrrlh\""
May 29 13:49:41.451760 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.451680    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 29 13:49:41.451930 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.451908    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 29 13:49:41.464660 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.464640    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"]
May 29 13:49:41.609892 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.609858    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbkf\" (UniqueName: \"kubernetes.io/projected/80aff121-eb55-4a11-af68-f04aef180345-kube-api-access-7zbkf\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.610064 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.609898    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.610064 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.609985    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.610064 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.610040    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.610064 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.610060    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711131 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711055    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711131 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711101    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711341 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711130    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711341 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711176    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbkf\" (UniqueName: \"kubernetes.io/projected/80aff121-eb55-4a11-af68-f04aef180345-kube-api-access-7zbkf\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711341 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711318    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.711530 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.711510    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-manifests\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.713509 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.713480    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80aff121-eb55-4a11-af68-f04aef180345-tmp\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.713710 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.713691    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.713751 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.713691    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80aff121-eb55-4a11-af68-f04aef180345-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.719959 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.719935    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbkf\" (UniqueName: \"kubernetes.io/projected/80aff121-eb55-4a11-af68-f04aef180345-kube-api-access-7zbkf\") pod \"opendatahub-operator-controller-manager-5cf69667cd-vkdjm\" (UID: \"80aff121-eb55-4a11-af68-f04aef180345\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.758974 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.758953    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:41.891656 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:41.891625    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"]
May 29 13:49:41.893004 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:49:41.892977    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aff121_eb55_4a11_af68_f04aef180345.slice/crio-aedc3c51ebc72b106d770cbbfa6fab2af1ac6b3510898c7d306230aaf4408580 WatchSource:0}: Error finding container aedc3c51ebc72b106d770cbbfa6fab2af1ac6b3510898c7d306230aaf4408580: Status 404 returned error can't find the container with id aedc3c51ebc72b106d770cbbfa6fab2af1ac6b3510898c7d306230aaf4408580
May 29 13:49:42.502580 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:42.502541    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm" event={"ID":"80aff121-eb55-4a11-af68-f04aef180345","Type":"ContainerStarted","Data":"aedc3c51ebc72b106d770cbbfa6fab2af1ac6b3510898c7d306230aaf4408580"}
May 29 13:49:45.526051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:45.526013    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm" event={"ID":"80aff121-eb55-4a11-af68-f04aef180345","Type":"ContainerStarted","Data":"0be66a6d6d67b106e7e7f8650c5e1b07d5b71c2955434eae9fc397bd6a35cb7f"}
May 29 13:49:46.530294 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:46.530242    2549 generic.go:358] "Generic (PLEG): container finished" podID="80aff121-eb55-4a11-af68-f04aef180345" containerID="0be66a6d6d67b106e7e7f8650c5e1b07d5b71c2955434eae9fc397bd6a35cb7f" exitCode=0
May 29 13:49:46.530294 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:46.530302    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm" event={"ID":"80aff121-eb55-4a11-af68-f04aef180345","Type":"ContainerDied","Data":"0be66a6d6d67b106e7e7f8650c5e1b07d5b71c2955434eae9fc397bd6a35cb7f"}
May 29 13:49:47.535402 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:47.535364    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm" event={"ID":"80aff121-eb55-4a11-af68-f04aef180345","Type":"ContainerStarted","Data":"a8118c7a10dbf459a78df0b49038552efe33db174b4c631e6d680dd05ca38e8e"}
May 29 13:49:47.535776 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:47.535473    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:49:47.558743 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:47.558697    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm" podStartSLOduration=1.618674987 podStartE2EDuration="6.558685233s" podCreationTimestamp="2026-05-29 13:49:41 +0000 UTC" firstStartedPulling="2026-05-29 13:49:41.894908653 +0000 UTC m=+432.377153107" lastFinishedPulling="2026-05-29 13:49:46.834918898 +0000 UTC m=+437.317163353" observedRunningTime="2026-05-29 13:49:47.556100216 +0000 UTC m=+438.038344693" watchObservedRunningTime="2026-05-29 13:49:47.558685233 +0000 UTC m=+438.040929710"
May 29 13:49:58.539785 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:49:58.539715    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf69667cd-vkdjm"
May 29 13:50:10.505050 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.505017    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"]
May 29 13:50:10.518437 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.518411    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.521583 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.521560    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 29 13:50:10.522202 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.522179    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 29 13:50:10.522527 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.522505    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 29 13:50:10.522645 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.522531    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 29 13:50:10.523022 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.523006    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"]
May 29 13:50:10.523876 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.523858    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 29 13:50:10.525916 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.525679    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6zxgb\""
May 29 13:50:10.642387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.642362    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.642506 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.642397    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-metrics-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.642506 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.642419    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8340e020-54df-4a67-8a39-4221babaaa6b-manager-config\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.642596 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.642517    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4tx\" (UniqueName: \"kubernetes.io/projected/8340e020-54df-4a67-8a39-4221babaaa6b-kube-api-access-2h4tx\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.743725 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.743699    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.743826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.743735    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-metrics-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.743826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.743755    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8340e020-54df-4a67-8a39-4221babaaa6b-manager-config\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.743826 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.743809    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4tx\" (UniqueName: \"kubernetes.io/projected/8340e020-54df-4a67-8a39-4221babaaa6b-kube-api-access-2h4tx\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.744558 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.744536    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8340e020-54df-4a67-8a39-4221babaaa6b-manager-config\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.746311 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.746291    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-metrics-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.746375 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.746294    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8340e020-54df-4a67-8a39-4221babaaa6b-cert\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.758644 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.758594    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4tx\" (UniqueName: \"kubernetes.io/projected/8340e020-54df-4a67-8a39-4221babaaa6b-kube-api-access-2h4tx\") pod \"lws-controller-manager-699cb996b8-hqvxf\" (UID: \"8340e020-54df-4a67-8a39-4221babaaa6b\") " pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.828875 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.828856    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:10.986842 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:10.986812    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"]
May 29 13:50:10.990337 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:50:10.990312    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8340e020_54df_4a67_8a39_4221babaaa6b.slice/crio-765e471adef5def7d5729cb3b732667c5ab4ea8737377c71175f21fabc5cd9bb WatchSource:0}: Error finding container 765e471adef5def7d5729cb3b732667c5ab4ea8737377c71175f21fabc5cd9bb: Status 404 returned error can't find the container with id 765e471adef5def7d5729cb3b732667c5ab4ea8737377c71175f21fabc5cd9bb
May 29 13:50:11.613960 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:11.613923    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf" event={"ID":"8340e020-54df-4a67-8a39-4221babaaa6b","Type":"ContainerStarted","Data":"765e471adef5def7d5729cb3b732667c5ab4ea8737377c71175f21fabc5cd9bb"}
May 29 13:50:15.633767 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:15.633732    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf" event={"ID":"8340e020-54df-4a67-8a39-4221babaaa6b","Type":"ContainerStarted","Data":"ad3235a6bcd4b8c6c77bce0c72f7f7919a2903ce6b96831ebefc395fce41294f"}
May 29 13:50:15.634145 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:15.633797    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:15.674071 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:15.674026    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf" podStartSLOduration=1.986070689 podStartE2EDuration="5.67401465s" podCreationTimestamp="2026-05-29 13:50:10 +0000 UTC" firstStartedPulling="2026-05-29 13:50:10.992026137 +0000 UTC m=+461.474270592" lastFinishedPulling="2026-05-29 13:50:14.679970083 +0000 UTC m=+465.162214553" observedRunningTime="2026-05-29 13:50:15.673839324 +0000 UTC m=+466.156083800" watchObservedRunningTime="2026-05-29 13:50:15.67401465 +0000 UTC m=+466.156259126"
May 29 13:50:26.639212 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:26.639180    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-699cb996b8-hqvxf"
May 29 13:50:32.216308 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.216250    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-b886db694-c5hvr"]
May 29 13:50:32.219688 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.219672    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.222089 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.222064    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
May 29 13:50:32.222225 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.222206    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ftt6b\""
May 29 13:50:32.228540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.228517    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b886db694-c5hvr"]
May 29 13:50:32.323469 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.323439    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca6b3bf2-636e-49f2-ac89-b2834275c528-redirect-config\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.323616 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.323480    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rmfz\" (UniqueName: \"kubernetes.io/projected/ca6b3bf2-636e-49f2-ac89-b2834275c528-kube-api-access-2rmfz\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.424430 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.424401    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca6b3bf2-636e-49f2-ac89-b2834275c528-redirect-config\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.424540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.424432    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rmfz\" (UniqueName: \"kubernetes.io/projected/ca6b3bf2-636e-49f2-ac89-b2834275c528-kube-api-access-2rmfz\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.425097 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.425080    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca6b3bf2-636e-49f2-ac89-b2834275c528-redirect-config\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.432542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.432513    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rmfz\" (UniqueName: \"kubernetes.io/projected/ca6b3bf2-636e-49f2-ac89-b2834275c528-kube-api-access-2rmfz\") pod \"dashboard-redirect-b886db694-c5hvr\" (UID: \"ca6b3bf2-636e-49f2-ac89-b2834275c528\") " pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.531509 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.531490    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-b886db694-c5hvr"
May 29 13:50:32.658115 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.658093    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-b886db694-c5hvr"]
May 29 13:50:32.660762 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:50:32.660737    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6b3bf2_636e_49f2_ac89_b2834275c528.slice/crio-fe1ffb66f8d0179c77ae40c94c1446037302dd1f64542248b7141f6faef04890 WatchSource:0}: Error finding container fe1ffb66f8d0179c77ae40c94c1446037302dd1f64542248b7141f6faef04890: Status 404 returned error can't find the container with id fe1ffb66f8d0179c77ae40c94c1446037302dd1f64542248b7141f6faef04890
May 29 13:50:32.689324 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:32.689294    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b886db694-c5hvr" event={"ID":"ca6b3bf2-636e-49f2-ac89-b2834275c528","Type":"ContainerStarted","Data":"fe1ffb66f8d0179c77ae40c94c1446037302dd1f64542248b7141f6faef04890"}
May 29 13:50:37.709411 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:37.709376    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-b886db694-c5hvr" event={"ID":"ca6b3bf2-636e-49f2-ac89-b2834275c528","Type":"ContainerStarted","Data":"cc69b2771fd253142d10b416d53b5c703d9f04732bfbf4fef5d7313e05141087"}
May 29 13:50:47.510703 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.510653    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-b886db694-c5hvr" podStartSLOduration=11.119759076 podStartE2EDuration="15.510638528s" podCreationTimestamp="2026-05-29 13:50:32 +0000 UTC" firstStartedPulling="2026-05-29 13:50:32.662528491 +0000 UTC m=+483.144772946" lastFinishedPulling="2026-05-29 13:50:37.053407943 +0000 UTC m=+487.535652398" observedRunningTime="2026-05-29 13:50:37.733007669 +0000 UTC m=+488.215252147" watchObservedRunningTime="2026-05-29 13:50:47.510638528 +0000 UTC m=+497.992883005"
May 29 13:50:47.512000 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.511982    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"]
May 29 13:50:47.518986 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.518958    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.522051 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.522028    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 29 13:50:47.522192 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.522173    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 29 13:50:47.522362 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.522345    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 29 13:50:47.522450 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.522380    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qktq6\""
May 29 13:50:47.531775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.531752    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"]
May 29 13:50:47.658427 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658401    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658579 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658430    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mffmg\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-kube-api-access-mffmg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658579 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658453    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658579 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658518    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658579 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658544    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658732 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658620    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658732 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658654    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658808 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658737    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6d71c4-68be-4a6e-a29e-220363ee1812-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.658808 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.658760    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760165 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760138    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760321 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760192    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6d71c4-68be-4a6e-a29e-220363ee1812-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760321 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760216    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760321 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760300    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760322    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mffmg\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-kube-api-access-mffmg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760349    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760393    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760423    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760693 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760466    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760693 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760603    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760693 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760619    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760874 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760817    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.760955 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.760932    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.761058 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.761040    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc6d71c4-68be-4a6e-a29e-220363ee1812-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.762739 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.762714    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.762987 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.762967    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.768983 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.768960    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mffmg\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-kube-api-access-mffmg\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.769084 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.769053    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc6d71c4-68be-4a6e-a29e-220363ee1812-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk\" (UID: \"fc6d71c4-68be-4a6e-a29e-220363ee1812\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.831979 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.831955    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:47.962782 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:47.962753    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"]
May 29 13:50:47.965117 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:50:47.965087    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6d71c4_68be_4a6e_a29e_220363ee1812.slice/crio-627b84c853f9ffe30394c356e653f71d832dacf37676f7c2cd98593c70e09e5a WatchSource:0}: Error finding container 627b84c853f9ffe30394c356e653f71d832dacf37676f7c2cd98593c70e09e5a: Status 404 returned error can't find the container with id 627b84c853f9ffe30394c356e653f71d832dacf37676f7c2cd98593c70e09e5a
May 29 13:50:48.745508 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:48.745479    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk" event={"ID":"fc6d71c4-68be-4a6e-a29e-220363ee1812","Type":"ContainerStarted","Data":"627b84c853f9ffe30394c356e653f71d832dacf37676f7c2cd98593c70e09e5a"}
May 29 13:50:51.142664 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.142630    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:50:51.142929 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.142696    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:50:51.142929 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.142727    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:50:51.757705 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.757666    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk" event={"ID":"fc6d71c4-68be-4a6e-a29e-220363ee1812","Type":"ContainerStarted","Data":"cd7dff2053dd4238bbe0e6204e9dac66bb428d0dc49db56dfb81b61663629672"}
May 29 13:50:51.781248 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.781206    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk" podStartSLOduration=1.606191098 podStartE2EDuration="4.781192884s" podCreationTimestamp="2026-05-29 13:50:47 +0000 UTC" firstStartedPulling="2026-05-29 13:50:47.967376277 +0000 UTC m=+498.449620733" lastFinishedPulling="2026-05-29 13:50:51.14237806 +0000 UTC m=+501.624622519" observedRunningTime="2026-05-29 13:50:51.780073495 +0000 UTC m=+502.262317971" watchObservedRunningTime="2026-05-29 13:50:51.781192884 +0000 UTC m=+502.263437361"
May 29 13:50:51.832681 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:51.832661    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:52.836755 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:52.836721    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:53.764141 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:53.764109    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:50:53.764957 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:50:53.764942    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk"
May 29 13:51:01.803438 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.803405    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:01.807186 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.807150    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:01.809868 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.809837    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 13:51:01.809991 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.809888    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 13:51:01.810717 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.810701    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-th5dh\""
May 29 13:51:01.815698 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.815528    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:01.865851 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.865816    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfh5\" (UniqueName: \"kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5\") pod \"kuadrant-operator-catalog-jvgq2\" (UID: \"efbbb354-3b62-4cd5-9094-9e92c44b5514\") " pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:01.966468 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.966425    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfh5\" (UniqueName: \"kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5\") pod \"kuadrant-operator-catalog-jvgq2\" (UID: \"efbbb354-3b62-4cd5-9094-9e92c44b5514\") " pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:01.974817 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:01.974789    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfh5\" (UniqueName: \"kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5\") pod \"kuadrant-operator-catalog-jvgq2\" (UID: \"efbbb354-3b62-4cd5-9094-9e92c44b5514\") " pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:02.118697 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.118621    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:02.170522 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.170240    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:02.251871 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.251845    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:02.254574 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:02.254538    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefbbb354_3b62_4cd5_9094_9e92c44b5514.slice/crio-df1a4b5613f9404983ab06c4683eec285e66f03ac5f40f77fee134efa5eaf7e1 WatchSource:0}: Error finding container df1a4b5613f9404983ab06c4683eec285e66f03ac5f40f77fee134efa5eaf7e1: Status 404 returned error can't find the container with id df1a4b5613f9404983ab06c4683eec285e66f03ac5f40f77fee134efa5eaf7e1
May 29 13:51:02.384633 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.384560    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l92j"]
May 29 13:51:02.389518 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.389502    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:02.401954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.400441    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l92j"]
May 29 13:51:02.471651 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.471620    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwxd\" (UniqueName: \"kubernetes.io/projected/c2428ea9-236f-40f6-989d-7ed3f366b55c-kube-api-access-2rwxd\") pod \"kuadrant-operator-catalog-4l92j\" (UID: \"c2428ea9-236f-40f6-989d-7ed3f366b55c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:02.572866 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.572823    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwxd\" (UniqueName: \"kubernetes.io/projected/c2428ea9-236f-40f6-989d-7ed3f366b55c-kube-api-access-2rwxd\") pod \"kuadrant-operator-catalog-4l92j\" (UID: \"c2428ea9-236f-40f6-989d-7ed3f366b55c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:02.581666 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.581638    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwxd\" (UniqueName: \"kubernetes.io/projected/c2428ea9-236f-40f6-989d-7ed3f366b55c-kube-api-access-2rwxd\") pod \"kuadrant-operator-catalog-4l92j\" (UID: \"c2428ea9-236f-40f6-989d-7ed3f366b55c\") " pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:02.706656 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.706565    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:02.802073 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.802032    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" event={"ID":"efbbb354-3b62-4cd5-9094-9e92c44b5514","Type":"ContainerStarted","Data":"df1a4b5613f9404983ab06c4683eec285e66f03ac5f40f77fee134efa5eaf7e1"}
May 29 13:51:02.834478 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:02.834453    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4l92j"]
May 29 13:51:02.836509 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:02.836480    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2428ea9_236f_40f6_989d_7ed3f366b55c.slice/crio-8fddf726aa771f33088fff27af036db2a4283a3776c76d87d3f1cb81897f2b08 WatchSource:0}: Error finding container 8fddf726aa771f33088fff27af036db2a4283a3776c76d87d3f1cb81897f2b08: Status 404 returned error can't find the container with id 8fddf726aa771f33088fff27af036db2a4283a3776c76d87d3f1cb81897f2b08
May 29 13:51:03.806493 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:03.806454    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l92j" event={"ID":"c2428ea9-236f-40f6-989d-7ed3f366b55c","Type":"ContainerStarted","Data":"8fddf726aa771f33088fff27af036db2a4283a3776c76d87d3f1cb81897f2b08"}
May 29 13:51:04.812801 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:04.812329    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" event={"ID":"efbbb354-3b62-4cd5-9094-9e92c44b5514","Type":"ContainerStarted","Data":"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"}
May 29 13:51:04.812801 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:04.812467    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" podUID="efbbb354-3b62-4cd5-9094-9e92c44b5514" containerName="registry-server" containerID="cri-o://2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af" gracePeriod=2
May 29 13:51:04.815496 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:04.815459    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4l92j" event={"ID":"c2428ea9-236f-40f6-989d-7ed3f366b55c","Type":"ContainerStarted","Data":"0822d7760aadf5ab77653ccdfcfd7920e543065f46ea56bb8b3ccbe908922c83"}
May 29 13:51:04.830941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:04.830896    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" podStartSLOduration=1.576850112 podStartE2EDuration="3.830884012s" podCreationTimestamp="2026-05-29 13:51:01 +0000 UTC" firstStartedPulling="2026-05-29 13:51:02.25594228 +0000 UTC m=+512.738186739" lastFinishedPulling="2026-05-29 13:51:04.509976184 +0000 UTC m=+514.992220639" observedRunningTime="2026-05-29 13:51:04.828995197 +0000 UTC m=+515.311239675" watchObservedRunningTime="2026-05-29 13:51:04.830884012 +0000 UTC m=+515.313128489"
May 29 13:51:04.844694 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:04.844649    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4l92j" podStartSLOduration=1.169785496 podStartE2EDuration="2.844634947s" podCreationTimestamp="2026-05-29 13:51:02 +0000 UTC" firstStartedPulling="2026-05-29 13:51:02.837944804 +0000 UTC m=+513.320189259" lastFinishedPulling="2026-05-29 13:51:04.512794256 +0000 UTC m=+514.995038710" observedRunningTime="2026-05-29 13:51:04.843683983 +0000 UTC m=+515.325928462" watchObservedRunningTime="2026-05-29 13:51:04.844634947 +0000 UTC m=+515.326879425"
May 29 13:51:05.068983 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.068924    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:05.096505 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.096471    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wfh5\" (UniqueName: \"kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5\") pod \"efbbb354-3b62-4cd5-9094-9e92c44b5514\" (UID: \"efbbb354-3b62-4cd5-9094-9e92c44b5514\") "
May 29 13:51:05.098520 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.098494    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5" (OuterVolumeSpecName: "kube-api-access-6wfh5") pod "efbbb354-3b62-4cd5-9094-9e92c44b5514" (UID: "efbbb354-3b62-4cd5-9094-9e92c44b5514"). InnerVolumeSpecName "kube-api-access-6wfh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:51:05.197629 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.197605    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wfh5\" (UniqueName: \"kubernetes.io/projected/efbbb354-3b62-4cd5-9094-9e92c44b5514-kube-api-access-6wfh5\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:51:05.819627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.819554    2549 generic.go:358] "Generic (PLEG): container finished" podID="efbbb354-3b62-4cd5-9094-9e92c44b5514" containerID="2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af" exitCode=0
May 29 13:51:05.819627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.819605    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2"
May 29 13:51:05.820067 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.819632    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" event={"ID":"efbbb354-3b62-4cd5-9094-9e92c44b5514","Type":"ContainerDied","Data":"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"}
May 29 13:51:05.820067 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.819663    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jvgq2" event={"ID":"efbbb354-3b62-4cd5-9094-9e92c44b5514","Type":"ContainerDied","Data":"df1a4b5613f9404983ab06c4683eec285e66f03ac5f40f77fee134efa5eaf7e1"}
May 29 13:51:05.820067 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.819679    2549 scope.go:117] "RemoveContainer" containerID="2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"
May 29 13:51:05.828456 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.828437    2549 scope.go:117] "RemoveContainer" containerID="2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"
May 29 13:51:05.828684 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:51:05.828668    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af\": container with ID starting with 2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af not found: ID does not exist" containerID="2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"
May 29 13:51:05.828750 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.828695    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af"} err="failed to get container status \"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af\": rpc error: code = NotFound desc = could not find container \"2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af\": container with ID starting with 2340cc12bea729d60716ae8a022820b5a046ecae2e5aefb13fadd095ac2c78af not found: ID does not exist"
May 29 13:51:05.839997 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.839977    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:05.844819 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:05.844801    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jvgq2"]
May 29 13:51:06.106917 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:06.106858    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efbbb354-3b62-4cd5-9094-9e92c44b5514" path="/var/lib/kubelet/pods/efbbb354-3b62-4cd5-9094-9e92c44b5514/volumes"
May 29 13:51:12.707142 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:12.707108    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:12.707142 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:12.707148    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:12.728704 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:12.728679    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:12.864731 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:12.864698    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4l92j"
May 29 13:51:34.929521 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.929490    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"]
May 29 13:51:34.929958 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.929874    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efbbb354-3b62-4cd5-9094-9e92c44b5514" containerName="registry-server"
May 29 13:51:34.929958 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.929885    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="efbbb354-3b62-4cd5-9094-9e92c44b5514" containerName="registry-server"
May 29 13:51:34.929958 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.929944    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="efbbb354-3b62-4cd5-9094-9e92c44b5514" containerName="registry-server"
May 29 13:51:34.934436 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.934419    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:34.937821 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.937802    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t4zk6\""
May 29 13:51:34.944661 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:34.944639    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"]
May 29 13:51:35.032953 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.032927    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.033069 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.032993    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmt86\" (UniqueName: \"kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.134216 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.134185    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt86\" (UniqueName: \"kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.134385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.134284    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.134620 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.134600    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.150627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.150605    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmt86\" (UniqueName: \"kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.245345 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.245290    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:35.383793 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.383771    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"]
May 29 13:51:35.387467 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:35.387439    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bc246b_60c9_45de_8249_f3043e55dc67.slice/crio-867592168e981aaa5e85f591bfdde83f5393e0e0a8ed6589d29727a0b83438f4 WatchSource:0}: Error finding container 867592168e981aaa5e85f591bfdde83f5393e0e0a8ed6589d29727a0b83438f4: Status 404 returned error can't find the container with id 867592168e981aaa5e85f591bfdde83f5393e0e0a8ed6589d29727a0b83438f4
May 29 13:51:35.920897 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:35.920864    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" event={"ID":"78bc246b-60c9-45de-8249-f3043e55dc67","Type":"ContainerStarted","Data":"867592168e981aaa5e85f591bfdde83f5393e0e0a8ed6589d29727a0b83438f4"}
May 29 13:51:36.853777 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.853738    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"]
May 29 13:51:36.859909 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.859883    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:36.862485 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.862458    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 29 13:51:36.862619 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.862507    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fq787\""
May 29 13:51:36.866972 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.866943    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"]
May 29 13:51:36.951567 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:36.951526    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66vg\" (UniqueName: \"kubernetes.io/projected/0f64f080-37ac-4014-b2c3-414d02842ef2-kube-api-access-k66vg\") pod \"dns-operator-controller-manager-648d5c98bc-bsj9n\" (UID: \"0f64f080-37ac-4014-b2c3-414d02842ef2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:37.052403 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:37.052363    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k66vg\" (UniqueName: \"kubernetes.io/projected/0f64f080-37ac-4014-b2c3-414d02842ef2-kube-api-access-k66vg\") pod \"dns-operator-controller-manager-648d5c98bc-bsj9n\" (UID: \"0f64f080-37ac-4014-b2c3-414d02842ef2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:37.062228 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:37.062198    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66vg\" (UniqueName: \"kubernetes.io/projected/0f64f080-37ac-4014-b2c3-414d02842ef2-kube-api-access-k66vg\") pod \"dns-operator-controller-manager-648d5c98bc-bsj9n\" (UID: \"0f64f080-37ac-4014-b2c3-414d02842ef2\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:37.173520 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:37.173444    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:37.320634 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:37.320603    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"]
May 29 13:51:37.323167 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:37.323135    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f64f080_37ac_4014_b2c3_414d02842ef2.slice/crio-cc86b2272d32584cfdf44c7072c919a3cb70fb1025bae80e6d23ca8e743d36fa WatchSource:0}: Error finding container cc86b2272d32584cfdf44c7072c919a3cb70fb1025bae80e6d23ca8e743d36fa: Status 404 returned error can't find the container with id cc86b2272d32584cfdf44c7072c919a3cb70fb1025bae80e6d23ca8e743d36fa
May 29 13:51:37.928895 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:37.928862    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n" event={"ID":"0f64f080-37ac-4014-b2c3-414d02842ef2","Type":"ContainerStarted","Data":"cc86b2272d32584cfdf44c7072c919a3cb70fb1025bae80e6d23ca8e743d36fa"}
May 29 13:51:39.691730 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.691698    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"]
May 29 13:51:39.694554 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.694532    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:39.697367 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.697346    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-snvrs\""
May 29 13:51:39.705901 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.705875    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"]
May 29 13:51:39.778763 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.778725    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrv7k\" (UniqueName: \"kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k\") pod \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" (UID: \"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:39.879920 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.879887    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrv7k\" (UniqueName: \"kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k\") pod \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" (UID: \"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:39.889603 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:39.889573    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrv7k\" (UniqueName: \"kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k\") pod \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" (UID: \"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:40.008581 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.008492    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:40.686495 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.686469    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"]
May 29 13:51:40.688667 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:40.688627    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34b0c1b_e40b_47f6_88b9_f3a6ccb84730.slice/crio-c94a96a9bc4b8150cdc0dd702309810caeabdaf919737e2d4265ccf070d9d6b9 WatchSource:0}: Error finding container c94a96a9bc4b8150cdc0dd702309810caeabdaf919737e2d4265ccf070d9d6b9: Status 404 returned error can't find the container with id c94a96a9bc4b8150cdc0dd702309810caeabdaf919737e2d4265ccf070d9d6b9
May 29 13:51:40.941301 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.941189    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n" event={"ID":"0f64f080-37ac-4014-b2c3-414d02842ef2","Type":"ContainerStarted","Data":"9a78a91dfda0520cfdfb9fb458f6ffdb28c5920984999ba063ada06f768ada83"}
May 29 13:51:40.941721 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.941325    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:40.942432 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.942400    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" event={"ID":"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730","Type":"ContainerStarted","Data":"c94a96a9bc4b8150cdc0dd702309810caeabdaf919737e2d4265ccf070d9d6b9"}
May 29 13:51:40.943759 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.943739    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" event={"ID":"78bc246b-60c9-45de-8249-f3043e55dc67","Type":"ContainerStarted","Data":"3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92"}
May 29 13:51:40.943837 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.943782    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:40.963464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.963426    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n" podStartSLOduration=1.749931461 podStartE2EDuration="4.963412967s" podCreationTimestamp="2026-05-29 13:51:36 +0000 UTC" firstStartedPulling="2026-05-29 13:51:37.325152731 +0000 UTC m=+547.807397191" lastFinishedPulling="2026-05-29 13:51:40.538634238 +0000 UTC m=+551.020878697" observedRunningTime="2026-05-29 13:51:40.963295066 +0000 UTC m=+551.445539540" watchObservedRunningTime="2026-05-29 13:51:40.963412967 +0000 UTC m=+551.445657443"
May 29 13:51:40.986842 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:40.986796    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" podStartSLOduration=1.835988181 podStartE2EDuration="6.986780842s" podCreationTimestamp="2026-05-29 13:51:34 +0000 UTC" firstStartedPulling="2026-05-29 13:51:35.389872345 +0000 UTC m=+545.872116800" lastFinishedPulling="2026-05-29 13:51:40.540664947 +0000 UTC m=+551.022909461" observedRunningTime="2026-05-29 13:51:40.98579638 +0000 UTC m=+551.468040857" watchObservedRunningTime="2026-05-29 13:51:40.986780842 +0000 UTC m=+551.469025320"
May 29 13:51:42.955954 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:42.955917    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" event={"ID":"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730","Type":"ContainerStarted","Data":"90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5"}
May 29 13:51:42.956368 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:42.956023    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:42.984212 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:42.984168    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" podStartSLOduration=2.3643273799999998 podStartE2EDuration="3.984157893s" podCreationTimestamp="2026-05-29 13:51:39 +0000 UTC" firstStartedPulling="2026-05-29 13:51:40.690475924 +0000 UTC m=+551.172720380" lastFinishedPulling="2026-05-29 13:51:42.310306429 +0000 UTC m=+552.792550893" observedRunningTime="2026-05-29 13:51:42.98067805 +0000 UTC m=+553.462922527" watchObservedRunningTime="2026-05-29 13:51:42.984157893 +0000 UTC m=+553.466402370"
May 29 13:51:51.953358 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:51.953325    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:51.953716 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:51.953386    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-bsj9n"
May 29 13:51:53.705703 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.705663    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"]
May 29 13:51:53.706114 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.705863    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" containerName="manager" containerID="cri-o://3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92" gracePeriod=2
May 29 13:51:53.716563 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.716537    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"]
May 29 13:51:53.729095 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.729071    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"]
May 29 13:51:53.729385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.729360    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" containerName="manager" containerID="cri-o://90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5" gracePeriod=2
May 29 13:51:53.732333 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.731815    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:53.733349 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.733325    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:51:53.733786 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.733770    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" containerName="manager"
May 29 13:51:53.733845 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.733790    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" containerName="manager"
May 29 13:51:53.733927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.733915    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" containerName="manager"
May 29 13:51:53.737157 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.737138    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.738099 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.738078    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"]
May 29 13:51:53.740223 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.740192    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.742914 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.742888    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.749546 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.749519    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.762447 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.762417    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:51:53.764226 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.764196    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"]
May 29 13:51:53.764627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.764611    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" containerName="manager"
May 29 13:51:53.764627 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.764626    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" containerName="manager"
May 29 13:51:53.764757 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.764719    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" containerName="manager"
May 29 13:51:53.767750 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.767732    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:53.790225 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.790202    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"]
May 29 13:51:53.791638 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.791607    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.793555 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.793524    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.793656 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.793571    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jptc\" (UniqueName: \"kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.793656 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.793606    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8vr\" (UniqueName: \"kubernetes.io/projected/f7e96511-76bc-42f3-9c15-4cf67a54d62c-kube-api-access-6q8vr\") pod \"limitador-operator-controller-manager-85c4996f8c-lknc4\" (UID: \"f7e96511-76bc-42f3-9c15-4cf67a54d62c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:53.793743 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.793662    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.894930 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.894548    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jptc\" (UniqueName: \"kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.894930 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.894615    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8vr\" (UniqueName: \"kubernetes.io/projected/f7e96511-76bc-42f3-9c15-4cf67a54d62c-kube-api-access-6q8vr\") pod \"limitador-operator-controller-manager-85c4996f8c-lknc4\" (UID: \"f7e96511-76bc-42f3-9c15-4cf67a54d62c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:53.894930 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.894695    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.895306 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.895157    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.905017 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.904989    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jptc\" (UniqueName: \"kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ldtdk\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:53.905362 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.905312    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8vr\" (UniqueName: \"kubernetes.io/projected/f7e96511-76bc-42f3-9c15-4cf67a54d62c-kube-api-access-6q8vr\") pod \"limitador-operator-controller-manager-85c4996f8c-lknc4\" (UID: \"f7e96511-76bc-42f3-9c15-4cf67a54d62c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:53.967503 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.967480    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:53.969917 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.969886    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.970615 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.970598    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:53.971893 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.971872    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.973645 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.973624    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.975436 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.975417    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:53.995556 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.995527    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume\") pod \"78bc246b-60c9-45de-8249-f3043e55dc67\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") "
May 29 13:51:53.995669 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.995640    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrv7k\" (UniqueName: \"kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k\") pod \"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730\" (UID: \"f34b0c1b-e40b-47f6-88b9-f3a6ccb84730\") "
May 29 13:51:53.995738 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.995694    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmt86\" (UniqueName: \"kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86\") pod \"78bc246b-60c9-45de-8249-f3043e55dc67\" (UID: \"78bc246b-60c9-45de-8249-f3043e55dc67\") "
May 29 13:51:53.995968 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.995941    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "78bc246b-60c9-45de-8249-f3043e55dc67" (UID: "78bc246b-60c9-45de-8249-f3043e55dc67"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:51:53.997719 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.997699    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k" (OuterVolumeSpecName: "kube-api-access-wrv7k") pod "f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" (UID: "f34b0c1b-e40b-47f6-88b9-f3a6ccb84730"). InnerVolumeSpecName "kube-api-access-wrv7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:51:53.997812 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.997769    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86" (OuterVolumeSpecName: "kube-api-access-bmt86") pod "78bc246b-60c9-45de-8249-f3043e55dc67" (UID: "78bc246b-60c9-45de-8249-f3043e55dc67"). InnerVolumeSpecName "kube-api-access-bmt86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:51:53.998150 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.998134    2549 generic.go:358] "Generic (PLEG): container finished" podID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" containerID="90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5" exitCode=0
May 29 13:51:53.998206 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.998170    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9"
May 29 13:51:53.998254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.998233    2549 scope.go:117] "RemoveContainer" containerID="90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5"
May 29 13:51:53.999497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.999469    2549 generic.go:358] "Generic (PLEG): container finished" podID="78bc246b-60c9-45de-8249-f3043e55dc67" containerID="3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92" exitCode=0
May 29 13:51:53.999578 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:53.999505    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9"
May 29 13:51:54.000453 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.000430    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.005011 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.004986    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.006309 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.006289    2549 scope.go:117] "RemoveContainer" containerID="90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5"
May 29 13:51:54.006588 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:51:54.006569    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5\": container with ID starting with 90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5 not found: ID does not exist" containerID="90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5"
May 29 13:51:54.006685 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.006595    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5"} err="failed to get container status \"90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5\": rpc error: code = NotFound desc = could not find container \"90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5\": container with ID starting with 90b4cb1b2aebaf0e39a1fafa7d7a34a9bd51bb77d256030523c88e67cc239ad5 not found: ID does not exist"
May 29 13:51:54.006685 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.006614    2549 scope.go:117] "RemoveContainer" containerID="3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92"
May 29 13:51:54.007195 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.007073    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.008887 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.008862    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.011141 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.011111    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.012396 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.012375    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"]
May 29 13:51:54.012921 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.012902    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.014654 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.014631    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.015445 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.015429    2549 scope.go:117] "RemoveContainer" containerID="3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92"
May 29 13:51:54.015703 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:51:54.015688    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92\": container with ID starting with 3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92 not found: ID does not exist" containerID="3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92"
May 29 13:51:54.015737 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.015711    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92"} err="failed to get container status \"3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92\": rpc error: code = NotFound desc = could not find container \"3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92\": container with ID starting with 3912d9051236ac75d20d323081e45ee8844664d7c683ab4c74d719b7e7d41a92 not found: ID does not exist"
May 29 13:51:54.016492 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.016477    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.017723 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.017709    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.027705 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.027688    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"]
May 29 13:51:54.044497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.044472    2549 status_manager.go:895] "Failed to get status for pod" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mcrz9" err="pods \"limitador-operator-controller-manager-85c4996f8c-mcrz9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.046572 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.046551    2549 status_manager.go:895] "Failed to get status for pod" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-lvwf9" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-lvwf9\" is forbidden: User \"system:node:ip-10-0-139-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-221.ec2.internal' and this object"
May 29 13:51:54.096407 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.096383    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.096497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.096410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxcb\" (UniqueName: \"kubernetes.io/projected/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-kube-api-access-zfxcb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.096497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.096447    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrv7k\" (UniqueName: \"kubernetes.io/projected/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730-kube-api-access-wrv7k\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:51:54.096497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.096475    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmt86\" (UniqueName: \"kubernetes.io/projected/78bc246b-60c9-45de-8249-f3043e55dc67-kube-api-access-bmt86\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:51:54.096497 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.096486    2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78bc246b-60c9-45de-8249-f3043e55dc67-extensions-socket-volume\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:51:54.106901 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.106880    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78bc246b-60c9-45de-8249-f3043e55dc67" path="/var/lib/kubelet/pods/78bc246b-60c9-45de-8249-f3043e55dc67/volumes"
May 29 13:51:54.107190 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.107178    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34b0c1b-e40b-47f6-88b9-f3a6ccb84730" path="/var/lib/kubelet/pods/f34b0c1b-e40b-47f6-88b9-f3a6ccb84730/volumes"
May 29 13:51:54.146698 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.146676    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:54.153287 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.153253    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:54.197936 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.197798    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.197936 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.197851    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxcb\" (UniqueName: \"kubernetes.io/projected/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-kube-api-access-zfxcb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.198721 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.198671    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.210232 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.209873    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxcb\" (UniqueName: \"kubernetes.io/projected/bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7-kube-api-access-zfxcb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vqf2f\" (UID: \"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.320988 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.320956    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:51:54.322908 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:54.322882    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef5ebdd_8853_4d79_a58a_aba04773f7c0.slice/crio-00e6ba82c87fb9eae58e7ead8e6acc38932a2c8c1a9482fa2efe71d21190cb4f WatchSource:0}: Error finding container 00e6ba82c87fb9eae58e7ead8e6acc38932a2c8c1a9482fa2efe71d21190cb4f: Status 404 returned error can't find the container with id 00e6ba82c87fb9eae58e7ead8e6acc38932a2c8c1a9482fa2efe71d21190cb4f
May 29 13:51:54.323116 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.323096    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"]
May 29 13:51:54.323697 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:54.323680    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e96511_76bc_42f3_9c15_4cf67a54d62c.slice/crio-3250774b1b2d2650369f8dbd834d4d3e10b1f6d01ed7a007534bbc658bfc5e94 WatchSource:0}: Error finding container 3250774b1b2d2650369f8dbd834d4d3e10b1f6d01ed7a007534bbc658bfc5e94: Status 404 returned error can't find the container with id 3250774b1b2d2650369f8dbd834d4d3e10b1f6d01ed7a007534bbc658bfc5e94
May 29 13:51:54.327808 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.327792    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:54.474660 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:54.474635    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"]
May 29 13:51:54.476201 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:51:54.476178    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc6bc34_8e8b_4a66_9cd5_f2104a5d91e7.slice/crio-5f0304b75daf59a1eb4689b66016ff8bf50dc11d47c4b83b98f2a2b6b34e9ba2 WatchSource:0}: Error finding container 5f0304b75daf59a1eb4689b66016ff8bf50dc11d47c4b83b98f2a2b6b34e9ba2: Status 404 returned error can't find the container with id 5f0304b75daf59a1eb4689b66016ff8bf50dc11d47c4b83b98f2a2b6b34e9ba2
May 29 13:51:55.004634 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.004535    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4" event={"ID":"f7e96511-76bc-42f3-9c15-4cf67a54d62c","Type":"ContainerStarted","Data":"4c4e87d2fd2091ed8cb850dcb172f1741ecfbc3a4103c7224af9a944bd05b3c0"}
May 29 13:51:55.004634 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.004578    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4" event={"ID":"f7e96511-76bc-42f3-9c15-4cf67a54d62c","Type":"ContainerStarted","Data":"3250774b1b2d2650369f8dbd834d4d3e10b1f6d01ed7a007534bbc658bfc5e94"}
May 29 13:51:55.005090 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.004738    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:51:55.006206 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.006098    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" event={"ID":"eef5ebdd-8853-4d79-a58a-aba04773f7c0","Type":"ContainerStarted","Data":"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"}
May 29 13:51:55.006206 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.006128    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" event={"ID":"eef5ebdd-8853-4d79-a58a-aba04773f7c0","Type":"ContainerStarted","Data":"00e6ba82c87fb9eae58e7ead8e6acc38932a2c8c1a9482fa2efe71d21190cb4f"}
May 29 13:51:55.006206 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.006170    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:51:55.009021 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.008995    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f" event={"ID":"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7","Type":"ContainerStarted","Data":"ebc12396d8f76494a81dd59240cef667bcb47869f249cba008b7f0f8b55822e8"}
May 29 13:51:55.009021 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.009022    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f" event={"ID":"bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7","Type":"ContainerStarted","Data":"5f0304b75daf59a1eb4689b66016ff8bf50dc11d47c4b83b98f2a2b6b34e9ba2"}
May 29 13:51:55.009310 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.009293    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:51:55.027656 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.027612    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4" podStartSLOduration=2.027599392 podStartE2EDuration="2.027599392s" podCreationTimestamp="2026-05-29 13:51:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:51:55.026829523 +0000 UTC m=+565.509074000" watchObservedRunningTime="2026-05-29 13:51:55.027599392 +0000 UTC m=+565.509843869"
May 29 13:51:55.050331 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.050295    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f" podStartSLOduration=2.05028047 podStartE2EDuration="2.05028047s" podCreationTimestamp="2026-05-29 13:51:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:51:55.04790962 +0000 UTC m=+565.530154098" watchObservedRunningTime="2026-05-29 13:51:55.05028047 +0000 UTC m=+565.532524947"
May 29 13:51:55.070926 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:51:55.070893    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" podStartSLOduration=2.070882848 podStartE2EDuration="2.070882848s" podCreationTimestamp="2026-05-29 13:51:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:51:55.06989714 +0000 UTC m=+565.552141618" watchObservedRunningTime="2026-05-29 13:51:55.070882848 +0000 UTC m=+565.553127325"
May 29 13:52:06.016428 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.016385    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lknc4"
May 29 13:52:06.016984 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.016451    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:52:06.016984 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.016536    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vqf2f"
May 29 13:52:06.131038 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.131004    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:52:06.131302 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.131223    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" podUID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" containerName="manager" containerID="cri-o://5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750" gracePeriod=10
May 29 13:52:06.375019 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.374997    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:52:06.501444 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.501416    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume\") pod \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") "
May 29 13:52:06.501592 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.501472    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jptc\" (UniqueName: \"kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc\") pod \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\" (UID: \"eef5ebdd-8853-4d79-a58a-aba04773f7c0\") "
May 29 13:52:06.501770 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.501743    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eef5ebdd-8853-4d79-a58a-aba04773f7c0" (UID: "eef5ebdd-8853-4d79-a58a-aba04773f7c0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 13:52:06.503181 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.503157    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc" (OuterVolumeSpecName: "kube-api-access-8jptc") pod "eef5ebdd-8853-4d79-a58a-aba04773f7c0" (UID: "eef5ebdd-8853-4d79-a58a-aba04773f7c0"). InnerVolumeSpecName "kube-api-access-8jptc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:52:06.602622 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.602564    2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eef5ebdd-8853-4d79-a58a-aba04773f7c0-extensions-socket-volume\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:52:06.602622 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:06.602588    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jptc\" (UniqueName: \"kubernetes.io/projected/eef5ebdd-8853-4d79-a58a-aba04773f7c0-kube-api-access-8jptc\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:52:07.056564 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.056537    2549 generic.go:358] "Generic (PLEG): container finished" podID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" containerID="5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750" exitCode=0
May 29 13:52:07.056947 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.056601    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"
May 29 13:52:07.056947 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.056624    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" event={"ID":"eef5ebdd-8853-4d79-a58a-aba04773f7c0","Type":"ContainerDied","Data":"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"}
May 29 13:52:07.056947 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.056664    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk" event={"ID":"eef5ebdd-8853-4d79-a58a-aba04773f7c0","Type":"ContainerDied","Data":"00e6ba82c87fb9eae58e7ead8e6acc38932a2c8c1a9482fa2efe71d21190cb4f"}
May 29 13:52:07.056947 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.056680    2549 scope.go:117] "RemoveContainer" containerID="5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"
May 29 13:52:07.066100 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.066085    2549 scope.go:117] "RemoveContainer" containerID="5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"
May 29 13:52:07.066339 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:52:07.066308    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750\": container with ID starting with 5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750 not found: ID does not exist" containerID="5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"
May 29 13:52:07.066387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.066344    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750"} err="failed to get container status \"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750\": rpc error: code = NotFound desc = could not find container \"5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750\": container with ID starting with 5386680e01f5f6db543c0d52529556a2e834fb5df473b55ff25188482db6f750 not found: ID does not exist"
May 29 13:52:07.093060 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.093039    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:52:07.104745 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:07.104722    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ldtdk"]
May 29 13:52:08.107508 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:08.107477    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" path="/var/lib/kubelet/pods/eef5ebdd-8853-4d79-a58a-aba04773f7c0/volumes"
May 29 13:52:22.489620 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.489584    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"]
May 29 13:52:22.489986 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.489957    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" containerName="manager"
May 29 13:52:22.489986 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.489972    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" containerName="manager"
May 29 13:52:22.490081 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.490070    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="eef5ebdd-8853-4d79-a58a-aba04773f7c0" containerName="manager"
May 29 13:52:22.492320 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.492306    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.497460 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.497436    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kjjj7\""
May 29 13:52:22.515939 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.515909    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"]
May 29 13:52:22.636612 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636570    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636633    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvxq\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-kube-api-access-chvxq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d0113-eccf-4c66-9dd6-6f7483882a29-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636737    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636775 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636754    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636938 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636828    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636938 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636870    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636938 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636887    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.636938 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.636924    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.737657 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.737623    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.737900 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.737876    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.737909    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.737941    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.737979    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738135 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738032    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chvxq\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-kube-api-access-chvxq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738135 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738079    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d0113-eccf-4c66-9dd6-6f7483882a29-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738135 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738107    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738135 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738130    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738365 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738323    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738450 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738428    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738519 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738491    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738582 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738530    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.738807 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.738788    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/666d0113-eccf-4c66-9dd6-6f7483882a29-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.740251 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.740201    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.740540 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.740520    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.746064 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.746040    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.747370 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.747348    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvxq\" (UniqueName: \"kubernetes.io/projected/666d0113-eccf-4c66-9dd6-6f7483882a29-kube-api-access-chvxq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-bmnrk\" (UID: \"666d0113-eccf-4c66-9dd6-6f7483882a29\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.803513 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.803487    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:22.939535 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.939508    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"]
May 29 13:52:22.941506 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:52:22.941479    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666d0113_eccf_4c66_9dd6_6f7483882a29.slice/crio-c1eb8de347c1c1aa602d3c6d3a921bc9bec142e70e2ce13c63aca89e445674fa WatchSource:0}: Error finding container c1eb8de347c1c1aa602d3c6d3a921bc9bec142e70e2ce13c63aca89e445674fa: Status 404 returned error can't find the container with id c1eb8de347c1c1aa602d3c6d3a921bc9bec142e70e2ce13c63aca89e445674fa
May 29 13:52:22.943546 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.943518    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:52:22.943614 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.943576    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:52:22.943614 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:22.943603    2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 29 13:52:23.116061 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:23.116021    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk" event={"ID":"666d0113-eccf-4c66-9dd6-6f7483882a29","Type":"ContainerStarted","Data":"15a8ea792755eb3e5b1d38174eac1ee2109583c1e1f0683b325e9906f26f6bf2"}
May 29 13:52:23.116061 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:23.116063    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk" event={"ID":"666d0113-eccf-4c66-9dd6-6f7483882a29","Type":"ContainerStarted","Data":"c1eb8de347c1c1aa602d3c6d3a921bc9bec142e70e2ce13c63aca89e445674fa"}
May 29 13:52:23.804062 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:23.804029    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:24.808537 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:24.808509    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:24.829827 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:24.829779    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk" podStartSLOduration=2.829762392 podStartE2EDuration="2.829762392s" podCreationTimestamp="2026-05-29 13:52:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 13:52:23.140006884 +0000 UTC m=+593.622251362" watchObservedRunningTime="2026-05-29 13:52:24.829762392 +0000 UTC m=+595.312006870"
May 29 13:52:25.122823 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:25.122746    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:25.123682 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:25.123665    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-bmnrk"
May 29 13:52:27.183336 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.183303    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:52:27.186080 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.186052    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.188773 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.188755    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxrd4\""
May 29 13:52:27.189319 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.189301    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 29 13:52:27.198927 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.198901    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:52:27.226589 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.226558    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:52:27.277010 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.276988    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a73a0073-6563-4387-87e8-c00eef75e668-config-file\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.277121 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.277093    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7f4\" (UniqueName: \"kubernetes.io/projected/a73a0073-6563-4387-87e8-c00eef75e668-kube-api-access-6h7f4\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.377720 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.377686    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7f4\" (UniqueName: \"kubernetes.io/projected/a73a0073-6563-4387-87e8-c00eef75e668-kube-api-access-6h7f4\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.377843 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.377760    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a73a0073-6563-4387-87e8-c00eef75e668-config-file\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.378408 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.378389    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a73a0073-6563-4387-87e8-c00eef75e668-config-file\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.385861 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.385835    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7f4\" (UniqueName: \"kubernetes.io/projected/a73a0073-6563-4387-87e8-c00eef75e668-kube-api-access-6h7f4\") pod \"limitador-limitador-78c99df468-m8g29\" (UID: \"a73a0073-6563-4387-87e8-c00eef75e668\") " pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.497862 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.497789    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:27.643788 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:27.643764    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:52:27.644736 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:52:27.644713    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73a0073_6563_4387_87e8_c00eef75e668.slice/crio-8c235d3a356cf8201e6d58ddd348cb114aa072b38566e7b313c9fe8a27620fe2 WatchSource:0}: Error finding container 8c235d3a356cf8201e6d58ddd348cb114aa072b38566e7b313c9fe8a27620fe2: Status 404 returned error can't find the container with id 8c235d3a356cf8201e6d58ddd348cb114aa072b38566e7b313c9fe8a27620fe2
May 29 13:52:28.136310 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:28.136215    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29" event={"ID":"a73a0073-6563-4387-87e8-c00eef75e668","Type":"ContainerStarted","Data":"8c235d3a356cf8201e6d58ddd348cb114aa072b38566e7b313c9fe8a27620fe2"}
May 29 13:52:30.019180 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:30.018896    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:52:30.019538 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:30.019348    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:52:30.145254 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:30.145221    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29" event={"ID":"a73a0073-6563-4387-87e8-c00eef75e668","Type":"ContainerStarted","Data":"55730db3071e8e13b80ef59e41110b134d98fd7de30a4d59bb42a5daed14e1b7"}
May 29 13:52:30.145411 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:30.145395    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:52:30.164039 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:30.163997    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29" podStartSLOduration=0.774942553 podStartE2EDuration="3.163984475s" podCreationTimestamp="2026-05-29 13:52:27 +0000 UTC" firstStartedPulling="2026-05-29 13:52:27.646602807 +0000 UTC m=+598.128847262" lastFinishedPulling="2026-05-29 13:52:30.035644717 +0000 UTC m=+600.517889184" observedRunningTime="2026-05-29 13:52:30.161663924 +0000 UTC m=+600.643908400" watchObservedRunningTime="2026-05-29 13:52:30.163984475 +0000 UTC m=+600.646228981"
May 29 13:52:41.150164 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:52:41.150131    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-m8g29"
May 29 13:53:17.581491 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.581461    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:53:17.586688 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.586670    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:53:17.589132 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.589109    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bs99v\""
May 29 13:53:17.589239 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.589112    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 29 13:53:17.589970 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.589954    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 29 13:53:17.590028 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.589954    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 29 13:53:17.593690 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.593661    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:53:17.706738 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.706708    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25nxb\" (UniqueName: \"kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb\") pod \"maas-keycloak-0\" (UID: \"bca245f3-d447-4c12-b7df-51206c6abc4a\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:53:17.807877 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.807847    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25nxb\" (UniqueName: \"kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb\") pod \"maas-keycloak-0\" (UID: \"bca245f3-d447-4c12-b7df-51206c6abc4a\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:53:17.816482 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.816453    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25nxb\" (UniqueName: \"kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb\") pod \"maas-keycloak-0\" (UID: \"bca245f3-d447-4c12-b7df-51206c6abc4a\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:53:17.897452 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:17.897398    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:53:18.023119 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:18.023096    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:53:18.025727 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:53:18.025690    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca245f3_d447_4c12_b7df_51206c6abc4a.slice/crio-cd7a8115d3c9a3e95fe897bae05707afcc7b65d132f4f432ca78b3805bff714f WatchSource:0}: Error finding container cd7a8115d3c9a3e95fe897bae05707afcc7b65d132f4f432ca78b3805bff714f: Status 404 returned error can't find the container with id cd7a8115d3c9a3e95fe897bae05707afcc7b65d132f4f432ca78b3805bff714f
May 29 13:53:18.026978 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:18.026963    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 13:53:18.308314 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:18.308280    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bca245f3-d447-4c12-b7df-51206c6abc4a","Type":"ContainerStarted","Data":"cd7a8115d3c9a3e95fe897bae05707afcc7b65d132f4f432ca78b3805bff714f"}
May 29 13:53:23.330959 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:23.330920    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bca245f3-d447-4c12-b7df-51206c6abc4a","Type":"ContainerStarted","Data":"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"}
May 29 13:53:23.352810 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:23.352735    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.074592118 podStartE2EDuration="6.35271933s" podCreationTimestamp="2026-05-29 13:53:17 +0000 UTC" firstStartedPulling="2026-05-29 13:53:18.027089568 +0000 UTC m=+648.509334023" lastFinishedPulling="2026-05-29 13:53:22.30521678 +0000 UTC m=+652.787461235" observedRunningTime="2026-05-29 13:53:23.351564775 +0000 UTC m=+653.833809255" watchObservedRunningTime="2026-05-29 13:53:23.35271933 +0000 UTC m=+653.834963807"
May 29 13:53:23.898542 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:23.898496    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 29 13:53:23.900641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:23.900604    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:24.898415 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:24.898364    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:25.898043 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:25.897993    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:26.898791 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:26.898742    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:27.898892 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:27.898847    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:27.899888 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:27.899474    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 29 13:53:28.898134 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:28.898087    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:29.898302 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:29.898222    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:30.898655 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:30.898604    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:31.898887 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:31.898839    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:32.898740 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:32.898691    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:33.897928 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:33.897885    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:34.898391 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:34.898342    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
May 29 13:53:36.025083 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:36.025031    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 29 13:53:36.043993 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:36.043934    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 13:53:46.032055 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:53:46.032022    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:25.564896 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:25.564810    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:54:35.262387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:35.262343    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:35.262914 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:35.262599    2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" containerID="cri-o://16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308" gracePeriod=30
May 29 13:54:36.030425 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:36.030387    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 13:54:36.914934 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:36.914909    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.017431 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.017341    2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25nxb\" (UniqueName: \"kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb\") pod \"bca245f3-d447-4c12-b7df-51206c6abc4a\" (UID: \"bca245f3-d447-4c12-b7df-51206c6abc4a\") "
May 29 13:54:37.019363 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.019338    2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb" (OuterVolumeSpecName: "kube-api-access-25nxb") pod "bca245f3-d447-4c12-b7df-51206c6abc4a" (UID: "bca245f3-d447-4c12-b7df-51206c6abc4a"). InnerVolumeSpecName "kube-api-access-25nxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 13:54:37.118161 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.118134    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25nxb\" (UniqueName: \"kubernetes.io/projected/bca245f3-d447-4c12-b7df-51206c6abc4a-kube-api-access-25nxb\") on node \"ip-10-0-139-221.ec2.internal\" DevicePath \"\""
May 29 13:54:37.622743 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.622709    2549 generic.go:358] "Generic (PLEG): container finished" podID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerID="16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308" exitCode=143
May 29 13:54:37.622941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.622772    2549 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.622941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.622790    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bca245f3-d447-4c12-b7df-51206c6abc4a","Type":"ContainerDied","Data":"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"}
May 29 13:54:37.622941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.622830    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bca245f3-d447-4c12-b7df-51206c6abc4a","Type":"ContainerDied","Data":"cd7a8115d3c9a3e95fe897bae05707afcc7b65d132f4f432ca78b3805bff714f"}
May 29 13:54:37.622941 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.622850    2549 scope.go:117] "RemoveContainer" containerID="16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"
May 29 13:54:37.632387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.632310    2549 scope.go:117] "RemoveContainer" containerID="16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"
May 29 13:54:37.632582 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:54:37.632560    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308\": container with ID starting with 16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308 not found: ID does not exist" containerID="16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"
May 29 13:54:37.632641 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.632589    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308"} err="failed to get container status \"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308\": rpc error: code = NotFound desc = could not find container \"16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308\": container with ID starting with 16f70f392ee64f91840cccd63a93192e3f6ec7ce274be3845148edf9051a1308 not found: ID does not exist"
May 29 13:54:37.643937 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.643917    2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:37.652533 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.652513    2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:37.674426 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.674406    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:37.674839 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.674827    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak"
May 29 13:54:37.674880 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.674841    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak"
May 29 13:54:37.674939 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.674928    2549 memory_manager.go:356] "RemoveStaleState removing state" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" containerName="keycloak"
May 29 13:54:37.678001 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.677986    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.680666 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.680649    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 29 13:54:37.680759 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.680649    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
May 29 13:54:37.680759 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.680685    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bs99v\""
May 29 13:54:37.680958 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.680943    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 29 13:54:37.681037 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.681022    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 29 13:54:37.689911 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.689888    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:37.723272 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.723234    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lg2k\" (UniqueName: \"kubernetes.io/projected/1437f595-d975-48f2-b10a-f583ab490727-kube-api-access-9lg2k\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.723385 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.723286    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1437f595-d975-48f2-b10a-f583ab490727-test-realms\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.824703 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.824677    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lg2k\" (UniqueName: \"kubernetes.io/projected/1437f595-d975-48f2-b10a-f583ab490727-kube-api-access-9lg2k\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.824814 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.824714    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1437f595-d975-48f2-b10a-f583ab490727-test-realms\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.825427 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.825411    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1437f595-d975-48f2-b10a-f583ab490727-test-realms\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.833086 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.833065    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lg2k\" (UniqueName: \"kubernetes.io/projected/1437f595-d975-48f2-b10a-f583ab490727-kube-api-access-9lg2k\") pod \"maas-keycloak-0\" (UID: \"1437f595-d975-48f2-b10a-f583ab490727\") " pod="keycloak-system/maas-keycloak-0"
May 29 13:54:37.988070 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:37.988012    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:38.108024 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.107995    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca245f3-d447-4c12-b7df-51206c6abc4a" path="/var/lib/kubelet/pods/bca245f3-d447-4c12-b7df-51206c6abc4a/volumes"
May 29 13:54:38.116805 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.116779    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 29 13:54:38.120482 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:54:38.120458    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1437f595_d975_48f2_b10a_f583ab490727.slice/crio-004bb4252dbda99465742749c7686d5728d762e83a37bbdf2d2de0f6b8d668f2 WatchSource:0}: Error finding container 004bb4252dbda99465742749c7686d5728d762e83a37bbdf2d2de0f6b8d668f2: Status 404 returned error can't find the container with id 004bb4252dbda99465742749c7686d5728d762e83a37bbdf2d2de0f6b8d668f2
May 29 13:54:38.630456 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.630424    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1437f595-d975-48f2-b10a-f583ab490727","Type":"ContainerStarted","Data":"3000139ae7eb575cf5146892f041136541b0bdfc116bf92c7f0e555251163208"}
May 29 13:54:38.630456 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.630460    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1437f595-d975-48f2-b10a-f583ab490727","Type":"ContainerStarted","Data":"004bb4252dbda99465742749c7686d5728d762e83a37bbdf2d2de0f6b8d668f2"}
May 29 13:54:38.652309 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.652232    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.342401732 podStartE2EDuration="1.652214068s" podCreationTimestamp="2026-05-29 13:54:37 +0000 UTC" firstStartedPulling="2026-05-29 13:54:38.121733802 +0000 UTC m=+728.603978257" lastFinishedPulling="2026-05-29 13:54:38.431546133 +0000 UTC m=+728.913790593" observedRunningTime="2026-05-29 13:54:38.648376789 +0000 UTC m=+729.130621280" watchObservedRunningTime="2026-05-29 13:54:38.652214068 +0000 UTC m=+729.134458546"
May 29 13:54:38.989293 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.989221    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:38.990924 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:38.990893    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:39.989163 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:39.989109    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:40.988975 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:40.988931    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:41.989571 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:41.989513    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:42.989231 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:42.989169    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:43.989009 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:43.988958    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:44.989603 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:44.989550    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:45.988809 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:45.988758    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:46.989177 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:46.989126    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:47.988820 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:47.988772    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:47.989185 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:47.989151    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:48.989401 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:48.989350    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:49.988915 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:49.988866    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:50.989433 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:50.989386    2549 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused"
May 29 13:54:52.116429 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:52.116381    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 29 13:54:52.136101 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:54:52.135775    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1437f595-d975-48f2-b10a-f583ab490727" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 29 13:55:02.123648 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:02.123609    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 29 13:55:26.372168 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.372137    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"]
May 29 13:55:26.376698 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.376669    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.379386 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.379363    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 29 13:55:26.380130 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.380109    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vfxdw\""
May 29 13:55:26.380241 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.380111    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 29 13:55:26.380241 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.380111    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 29 13:55:26.387119 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.387093    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"]
May 29 13:55:26.490090 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490059    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w4g4\" (UniqueName: \"kubernetes.io/projected/00260a0f-b233-4273-9bd9-37338d89e2b7-kube-api-access-5w4g4\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.490234 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490099    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.490234 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490130    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.490234 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.490365 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490295    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00260a0f-b233-4273-9bd9-37338d89e2b7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.490365 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.490336    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.590742 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590713    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.590889 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590755    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.590889 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590788    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.590889 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590831    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00260a0f-b233-4273-9bd9-37338d89e2b7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.591002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590894    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.591002 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.590957    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4g4\" (UniqueName: \"kubernetes.io/projected/00260a0f-b233-4273-9bd9-37338d89e2b7-kube-api-access-5w4g4\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.591173 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.591151    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.591271 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.591239    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.591328 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.591314    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.593118 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.593099    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00260a0f-b233-4273-9bd9-37338d89e2b7-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.593277 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.593247    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00260a0f-b233-4273-9bd9-37338d89e2b7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.598942 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.598921    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w4g4\" (UniqueName: \"kubernetes.io/projected/00260a0f-b233-4273-9bd9-37338d89e2b7-kube-api-access-5w4g4\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst\" (UID: \"00260a0f-b233-4273-9bd9-37338d89e2b7\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.689590 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.689531    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:26.893615 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:26.893581    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:55:27.038505 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:27.038480    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"]
May 29 13:55:27.040530 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:55:27.040498    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00260a0f_b233_4273_9bd9_37338d89e2b7.slice/crio-9dca3e5f2dd3fc8ffea712b7daeb37577b6b0e0edf1c0d8219e141b848c56d32 WatchSource:0}: Error finding container 9dca3e5f2dd3fc8ffea712b7daeb37577b6b0e0edf1c0d8219e141b848c56d32: Status 404 returned error can't find the container with id 9dca3e5f2dd3fc8ffea712b7daeb37577b6b0e0edf1c0d8219e141b848c56d32
May 29 13:55:27.828994 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:27.828956    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst" event={"ID":"00260a0f-b233-4273-9bd9-37338d89e2b7","Type":"ContainerStarted","Data":"9dca3e5f2dd3fc8ffea712b7daeb37577b6b0e0edf1c0d8219e141b848c56d32"}
May 29 13:55:31.846792 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:31.846750    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst" event={"ID":"00260a0f-b233-4273-9bd9-37338d89e2b7","Type":"ContainerStarted","Data":"efe46ba74a37afdf57f9ef55dd20f6e8dadd136ff509a9269417cedca1a6b391"}
May 29 13:55:32.505090 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.505060    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"]
May 29 13:55:32.508662 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.508644    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.511504 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.511485    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 29 13:55:32.521746 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.521721    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"]
May 29 13:55:32.531676 ip-10-0-139-221 kubenswrapper[2549]: E0529 13:55:32.531565    2549 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00260a0f_b233_4273_9bd9_37338d89e2b7.slice/crio-conmon-efe46ba74a37afdf57f9ef55dd20f6e8dadd136ff509a9269417cedca1a6b391.scope\": RecentStats: unable to find data in memory cache]"
May 29 13:55:32.651018 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.650988    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.651189 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.651030    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.651189 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.651055    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqxk\" (UniqueName: \"kubernetes.io/projected/983b5509-8afe-401c-8364-8ba772fc14a7-kube-api-access-9xqxk\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.651310 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.651182    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983b5509-8afe-401c-8364-8ba772fc14a7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.651310 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.651241    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.651404 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.651317    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752298 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752208    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983b5509-8afe-401c-8364-8ba772fc14a7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752298 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752254    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752494 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752301    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752494 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752368    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752494 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752410    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752494 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752441    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqxk\" (UniqueName: \"kubernetes.io/projected/983b5509-8afe-401c-8364-8ba772fc14a7-kube-api-access-9xqxk\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752679 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752658    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.752795 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752757    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.753014 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.752986    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.754770 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.754749    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/983b5509-8afe-401c-8364-8ba772fc14a7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.754770 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.754765    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/983b5509-8afe-401c-8364-8ba772fc14a7-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.761387 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.761365    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqxk\" (UniqueName: \"kubernetes.io/projected/983b5509-8afe-401c-8364-8ba772fc14a7-kube-api-access-9xqxk\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-v9697\" (UID: \"983b5509-8afe-401c-8364-8ba772fc14a7\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.835918 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.835896    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:32.852888 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.852861    2549 generic.go:358] "Generic (PLEG): container finished" podID="00260a0f-b233-4273-9bd9-37338d89e2b7" containerID="efe46ba74a37afdf57f9ef55dd20f6e8dadd136ff509a9269417cedca1a6b391" exitCode=0
May 29 13:55:32.853229 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.852908    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst" event={"ID":"00260a0f-b233-4273-9bd9-37338d89e2b7","Type":"ContainerDied","Data":"efe46ba74a37afdf57f9ef55dd20f6e8dadd136ff509a9269417cedca1a6b391"}
May 29 13:55:32.975996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:32.975973    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"]
May 29 13:55:32.978241 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:55:32.978215    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983b5509_8afe_401c_8364_8ba772fc14a7.slice/crio-0cc8db22caabe0de3753592eeb4469d4ffcc768a582b63ded52928e1a122ea45 WatchSource:0}: Error finding container 0cc8db22caabe0de3753592eeb4469d4ffcc768a582b63ded52928e1a122ea45: Status 404 returned error can't find the container with id 0cc8db22caabe0de3753592eeb4469d4ffcc768a582b63ded52928e1a122ea45
May 29 13:55:33.165888 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:33.165857    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:55:33.860378 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:33.860343    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697" event={"ID":"983b5509-8afe-401c-8364-8ba772fc14a7","Type":"ContainerStarted","Data":"b6ff5adc7805ba7d662ded5c269ed97eda7822d208b32cf532531fd39af77d40"}
May 29 13:55:33.860814 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:33.860385    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697" event={"ID":"983b5509-8afe-401c-8364-8ba772fc14a7","Type":"ContainerStarted","Data":"0cc8db22caabe0de3753592eeb4469d4ffcc768a582b63ded52928e1a122ea45"}
May 29 13:55:34.869120 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:34.869083    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst" event={"ID":"00260a0f-b233-4273-9bd9-37338d89e2b7","Type":"ContainerStarted","Data":"4e36d6c4d37743927345e2f40c0a00402a4418b48dbf04a027ea0d966491fe6f"}
May 29 13:55:34.870464 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:34.870438    2549 generic.go:358] "Generic (PLEG): container finished" podID="983b5509-8afe-401c-8364-8ba772fc14a7" containerID="b6ff5adc7805ba7d662ded5c269ed97eda7822d208b32cf532531fd39af77d40" exitCode=0
May 29 13:55:34.870588 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:34.870511    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697" event={"ID":"983b5509-8afe-401c-8364-8ba772fc14a7","Type":"ContainerDied","Data":"b6ff5adc7805ba7d662ded5c269ed97eda7822d208b32cf532531fd39af77d40"}
May 29 13:55:34.890115 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:34.890076    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst" podStartSLOduration=1.761360855 podStartE2EDuration="8.890066118s" podCreationTimestamp="2026-05-29 13:55:26 +0000 UTC" firstStartedPulling="2026-05-29 13:55:27.042465414 +0000 UTC m=+777.524709870" lastFinishedPulling="2026-05-29 13:55:34.171170677 +0000 UTC m=+784.653415133" observedRunningTime="2026-05-29 13:55:34.887958545 +0000 UTC m=+785.370203035" watchObservedRunningTime="2026-05-29 13:55:34.890066118 +0000 UTC m=+785.372310591"
May 29 13:55:35.875371 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:35.875316    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697" event={"ID":"983b5509-8afe-401c-8364-8ba772fc14a7","Type":"ContainerStarted","Data":"10fb1f5fb1619fd03b77c10580963b5ae554796be4c635cf589cba443fcde06e"}
May 29 13:55:35.896707 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:35.896649    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697" podStartSLOduration=3.621743761 podStartE2EDuration="3.896635925s" podCreationTimestamp="2026-05-29 13:55:32 +0000 UTC" firstStartedPulling="2026-05-29 13:55:34.870942433 +0000 UTC m=+785.353186887" lastFinishedPulling="2026-05-29 13:55:35.145834591 +0000 UTC m=+785.628079051" observedRunningTime="2026-05-29 13:55:35.89511804 +0000 UTC m=+786.377362529" watchObservedRunningTime="2026-05-29 13:55:35.896635925 +0000 UTC m=+786.378880402"
May 29 13:55:36.689829 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:36.689795    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:36.689829 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:36.689828    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:36.702588 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:36.702563    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:36.890500 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:36.890473    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst"
May 29 13:55:39.863788 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:39.863753    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:55:42.836392 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:42.836354    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:42.836392 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:42.836394    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:42.849892 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:42.849869    2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:42.913822 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:42.913794    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-v9697"
May 29 13:55:44.778718 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:55:44.778686    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:56:00.267806 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:00.267728    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:56:09.671222 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.671186    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"]
May 29 13:56:09.675272 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.675245    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.678042 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.678018    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 29 13:56:09.684859 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.684835    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"]
May 29 13:56:09.798121 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798093    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.798283 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798135    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.798283 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798153    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ba47dc-e580-4c03-b244-105ef603a8b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.798283 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798230    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.798424 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798345    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grnwl\" (UniqueName: \"kubernetes.io/projected/b8ba47dc-e580-4c03-b244-105ef603a8b7-kube-api-access-grnwl\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.798424 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.798373    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899803 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899764    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grnwl\" (UniqueName: \"kubernetes.io/projected/b8ba47dc-e580-4c03-b244-105ef603a8b7-kube-api-access-grnwl\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899813    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899845    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899889    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899915    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ba47dc-e580-4c03-b244-105ef603a8b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.899996 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.899958    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.900252 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.900234    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.900376 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.900355    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.900471 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.900449    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.902178 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.902159    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8ba47dc-e580-4c03-b244-105ef603a8b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.902531 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.902498    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8ba47dc-e580-4c03-b244-105ef603a8b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.908470 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.908446    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grnwl\" (UniqueName: \"kubernetes.io/projected/b8ba47dc-e580-4c03-b244-105ef603a8b7-kube-api-access-grnwl\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz\" (UID: \"b8ba47dc-e580-4c03-b244-105ef603a8b7\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:09.985904 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:09.985846    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"
May 29 13:56:10.117086 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:10.117054    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz"]
May 29 13:56:10.118335 ip-10-0-139-221 kubenswrapper[2549]: W0529 13:56:10.118309    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ba47dc_e580_4c03_b244_105ef603a8b7.slice/crio-fac3f5a87f039f9627d2bb1b2723a66be6690ad869f6d467896a3638c922779d WatchSource:0}: Error finding container fac3f5a87f039f9627d2bb1b2723a66be6690ad869f6d467896a3638c922779d: Status 404 returned error can't find the container with id fac3f5a87f039f9627d2bb1b2723a66be6690ad869f6d467896a3638c922779d
May 29 13:56:11.005237 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:11.005204    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz" event={"ID":"b8ba47dc-e580-4c03-b244-105ef603a8b7","Type":"ContainerStarted","Data":"65dfe4a8a14ba36653b553f1ad1bd22ac23404a8999421f9c4839d4b39623d7e"}
May 29 13:56:11.005237 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:11.005240    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz" event={"ID":"b8ba47dc-e580-4c03-b244-105ef603a8b7","Type":"ContainerStarted","Data":"fac3f5a87f039f9627d2bb1b2723a66be6690ad869f6d467896a3638c922779d"}
May 29 13:56:11.472290 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:56:11.472228    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-m8g29"]
May 29 13:57:30.048901 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:57:30.048832    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 13:57:30.051548 ip-10-0-139-221 kubenswrapper[2549]: I0529 13:57:30.051527    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 14:02:12.347076 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:12.346989    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz_b8ba47dc-e580-4c03-b244-105ef603a8b7/storage-initializer/0.log"
May 29 14:02:18.127629 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:18.127603    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b886db694-c5hvr_ca6b3bf2-636e-49f2-ac89-b2834275c528/nginx/0.log"
May 29 14:02:19.306167 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:19.306139    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-vkdjm_80aff121-eb55-4a11-af68-f04aef180345/copy-manifests/0.log"
May 29 14:02:19.315001 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:19.314968    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-vkdjm_80aff121-eb55-4a11-af68-f04aef180345/manager/0.log"
May 29 14:02:20.937390 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:20.937362    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bsj9n_0f64f080-37ac-4014-b2c3-414d02842ef2/manager/0.log"
May 29 14:02:21.169559 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:21.169530    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4l92j_c2428ea9-236f-40f6-989d-7ed3f366b55c/registry-server/0.log"
May 29 14:02:21.287535 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:21.287511    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vqf2f_bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7/manager/0.log"
May 29 14:02:21.402462 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:21.402433    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-m8g29_a73a0073-6563-4387-87e8-c00eef75e668/limitador/0.log"
May 29 14:02:21.511519 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:21.511477    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-lknc4_f7e96511-76bc-42f3-9c15-4cf67a54d62c/manager/0.log"
May 29 14:02:21.856562 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:21.856537    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk_fc6d71c4-68be-4a6e-a29e-220363ee1812/istio-proxy/0.log"
May 29 14:02:22.311882 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:22.311853    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-bmnrk_666d0113-eccf-4c66-9dd6-6f7483882a29/istio-proxy/0.log"
May 29 14:02:22.882817 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:22.882789    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst_00260a0f-b233-4273-9bd9-37338d89e2b7/storage-initializer/0.log"
May 29 14:02:22.890649 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:22.890624    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-nxfst_00260a0f-b233-4273-9bd9-37338d89e2b7/main/0.log"
May 29 14:02:23.004789 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:23.004769    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-v9697_983b5509-8afe-401c-8364-8ba772fc14a7/main/0.log"
May 29 14:02:23.011142 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:23.011119    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-v9697_983b5509-8afe-401c-8364-8ba772fc14a7/storage-initializer/0.log"
May 29 14:02:23.487930 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:23.487900    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-8s5zz_b8ba47dc-e580-4c03-b244-105ef603a8b7/storage-initializer/0.log"
May 29 14:02:30.080908 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:30.080877    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 14:02:30.084682 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:30.084665    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 14:02:30.842860 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:30.842830    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ww9cs_1fb502ed-dfcb-4a9b-b2d5-2e1b4f8d30d0/global-pull-secret-syncer/0.log"
May 29 14:02:30.893492 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:30.893466    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bcrfd_e69e4102-eb96-48ef-a774-3e0e20c555e0/konnectivity-agent/0.log"
May 29 14:02:30.986638 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:30.986604    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-221.ec2.internal_b9dce095611a9775221d01535f4957b7/haproxy/0.log"
May 29 14:02:34.875366 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:34.875284    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-bsj9n_0f64f080-37ac-4014-b2c3-414d02842ef2/manager/0.log"
May 29 14:02:34.935788 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:34.935748    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4l92j_c2428ea9-236f-40f6-989d-7ed3f366b55c/registry-server/0.log"
May 29 14:02:34.978916 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:34.978890    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vqf2f_bdc6bc34-8e8b-4a66-9cd5-f2104a5d91e7/manager/0.log"
May 29 14:02:35.000987 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:35.000961    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-m8g29_a73a0073-6563-4387-87e8-c00eef75e668/limitador/0.log"
May 29 14:02:35.043494 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:35.043465    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-lknc4_f7e96511-76bc-42f3-9c15-4cf67a54d62c/manager/0.log"
May 29 14:02:36.241201 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.241171    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/alertmanager/0.log"
May 29 14:02:36.264086 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.264034    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/config-reloader/0.log"
May 29 14:02:36.286895 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.286871    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/kube-rbac-proxy-web/0.log"
May 29 14:02:36.315959 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.315935    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/kube-rbac-proxy/0.log"
May 29 14:02:36.343033 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.343009    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/kube-rbac-proxy-metric/0.log"
May 29 14:02:36.367863 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.367841    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/prom-label-proxy/0.log"
May 29 14:02:36.390688 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.390655    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8358f806-ad84-444a-bf44-cf50550e1101/init-config-reloader/0.log"
May 29 14:02:36.423781 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.423700    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-hrrgj_88645056-d01c-4f0d-8b42-0e911ee1d7b6/cluster-monitoring-operator/0.log"
May 29 14:02:36.519029 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.519006    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d68dbcdd9-8gjph_44399bc5-2bf2-47af-b688-3d83ba6dcb1b/metrics-server/0.log"
May 29 14:02:36.763346 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.763253    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww2x4_1adeec54-bec5-4afa-aada-4a6874f9a1bd/node-exporter/0.log"
May 29 14:02:36.792889 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.792862    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww2x4_1adeec54-bec5-4afa-aada-4a6874f9a1bd/kube-rbac-proxy/0.log"
May 29 14:02:36.813423 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.813401    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ww2x4_1adeec54-bec5-4afa-aada-4a6874f9a1bd/init-textfile/0.log"
May 29 14:02:36.847671 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.847649    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vkmwt_97fa0e46-f896-4f98-a6ff-e8d689198ac8/kube-rbac-proxy-main/0.log"
May 29 14:02:36.872442 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.872424    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vkmwt_97fa0e46-f896-4f98-a6ff-e8d689198ac8/kube-rbac-proxy-self/0.log"
May 29 14:02:36.894556 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.894526    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-vkmwt_97fa0e46-f896-4f98-a6ff-e8d689198ac8/openshift-state-metrics/0.log"
May 29 14:02:36.956060 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.956033    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/prometheus/0.log"
May 29 14:02:36.981496 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:36.981475    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/config-reloader/0.log"
May 29 14:02:37.010383 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.010358    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/thanos-sidecar/0.log"
May 29 14:02:37.035928 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.035911    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/kube-rbac-proxy-web/0.log"
May 29 14:02:37.060953 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.060930    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/kube-rbac-proxy/0.log"
May 29 14:02:37.086038 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.085994    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/kube-rbac-proxy-thanos/0.log"
May 29 14:02:37.121930 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.121910    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f5faa883-2caf-4ce1-9b4c-842a64be9fa1/init-config-reloader/0.log"
May 29 14:02:37.230746 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.230724    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-2xdm9_4e6ccd0e-2da5-44ae-b138-e0dda8692936/prometheus-operator-admission-webhook/0.log"
May 29 14:02:37.265849 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.265826    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c74858cf9-g6g4f_da27dda2-1a81-4715-83ec-77710befafc4/telemeter-client/0.log"
May 29 14:02:37.296383 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.296311    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c74858cf9-g6g4f_da27dda2-1a81-4715-83ec-77710befafc4/reload/0.log"
May 29 14:02:37.332226 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.332194    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c74858cf9-g6g4f_da27dda2-1a81-4715-83ec-77710befafc4/kube-rbac-proxy/0.log"
May 29 14:02:37.365546 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.365521    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/thanos-query/0.log"
May 29 14:02:37.388780 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.388759    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/kube-rbac-proxy-web/0.log"
May 29 14:02:37.414008 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.413985    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/kube-rbac-proxy/0.log"
May 29 14:02:37.435664 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.435638    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/prom-label-proxy/0.log"
May 29 14:02:37.464133 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.464109    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/kube-rbac-proxy-rules/0.log"
May 29 14:02:37.486662 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:37.486635    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86d85c69b4-75jzl_53fc898f-8aa5-4864-b70f-dfc366578623/kube-rbac-proxy-metrics/0.log"
May 29 14:02:38.697176 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:38.697150    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-vgb7f_05667d3a-6e15-47d1-90ce-2e661b96c974/networking-console-plugin/0.log"
May 29 14:02:39.806404 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:39.806375    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-dzdnm_d658f228-bc05-415e-9c0b-601b030dbdef/download-server/0.log"
May 29 14:02:40.153753 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.153672    2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"]
May 29 14:02:40.157683 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.157658    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.160223 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.160196    2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mcwqr\"/\"default-dockercfg-846cz\""
May 29 14:02:40.160354 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.160245    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcwqr\"/\"kube-root-ca.crt\""
May 29 14:02:40.160354 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.160252    2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcwqr\"/\"openshift-service-ca.crt\""
May 29 14:02:40.168947 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.168928    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"]
May 29 14:02:40.259361 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.259333    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-podres\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.259514 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.259374    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-proc\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.259514 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.259430    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-lib-modules\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.259639 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.259512    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4qvw\" (UniqueName: \"kubernetes.io/projected/fa30999c-80d1-4ea0-b211-d41587782f7c-kube-api-access-f4qvw\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.259639 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.259537    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-sys\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360622 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360594    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4qvw\" (UniqueName: \"kubernetes.io/projected/fa30999c-80d1-4ea0-b211-d41587782f7c-kube-api-access-f4qvw\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360775 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360631    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-sys\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360775 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360650    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-podres\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360775 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360677    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-proc\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360775 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360724    2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-lib-modules\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360775 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360730    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-sys\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360993 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360797    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-podres\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360993 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360835    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-lib-modules\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.360993 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.360833    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa30999c-80d1-4ea0-b211-d41587782f7c-proc\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.369868 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.369846    2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4qvw\" (UniqueName: \"kubernetes.io/projected/fa30999c-80d1-4ea0-b211-d41587782f7c-kube-api-access-f4qvw\") pod \"perf-node-gather-daemonset-8vqc9\" (UID: \"fa30999c-80d1-4ea0-b211-d41587782f7c\") " pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.447564 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.447496    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-h6zhf_e5acb689-7c6d-4e66-8316-cc55ac46bb6a/volume-data-source-validator/0.log"
May 29 14:02:40.468846 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.468828    2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:40.599281 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.599238    2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"]
May 29 14:02:40.601485 ip-10-0-139-221 kubenswrapper[2549]: W0529 14:02:40.601454    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfa30999c_80d1_4ea0_b211_d41587782f7c.slice/crio-ca1b5160d43985fec83a0c06312ef3178d901f9347b57ad27e6d69d46917b883 WatchSource:0}: Error finding container ca1b5160d43985fec83a0c06312ef3178d901f9347b57ad27e6d69d46917b883: Status 404 returned error can't find the container with id ca1b5160d43985fec83a0c06312ef3178d901f9347b57ad27e6d69d46917b883
May 29 14:02:40.603122 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:40.603105    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 14:02:41.473241 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.473203    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9" event={"ID":"fa30999c-80d1-4ea0-b211-d41587782f7c","Type":"ContainerStarted","Data":"58a98e39761caaf90a0fda3d67bcf863beeade30ff8812f91ac6468432689d5a"}
May 29 14:02:41.473241 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.473241    2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9" event={"ID":"fa30999c-80d1-4ea0-b211-d41587782f7c","Type":"ContainerStarted","Data":"ca1b5160d43985fec83a0c06312ef3178d901f9347b57ad27e6d69d46917b883"}
May 29 14:02:41.473800 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.473430    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:41.493045 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.493003    2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9" podStartSLOduration=1.492986712 podStartE2EDuration="1.492986712s" podCreationTimestamp="2026-05-29 14:02:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:02:41.491729546 +0000 UTC m=+1211.973974023" watchObservedRunningTime="2026-05-29 14:02:41.492986712 +0000 UTC m=+1211.975231187"
May 29 14:02:41.543055 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.543028    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hrkf_8a195377-00dd-4e32-b515-491c5986e765/dns/0.log"
May 29 14:02:41.566433 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.566414    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hrkf_8a195377-00dd-4e32-b515-491c5986e765/kube-rbac-proxy/0.log"
May 29 14:02:41.701444 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:41.701423    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w9b22_557e09c2-7c01-4247-89c2-107680229bf9/dns-node-resolver/0.log"
May 29 14:02:42.232652 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:42.232616    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kp9zf_aeaebd06-5f72-40d5-a4b0-2fd5ff211ea3/node-ca/0.log"
May 29 14:02:43.118491 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:43.118458    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bdtsnk_fc6d71c4-68be-4a6e-a29e-220363ee1812/istio-proxy/0.log"
May 29 14:02:43.260592 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:43.260565    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-bmnrk_666d0113-eccf-4c66-9dd6-6f7483882a29/istio-proxy/0.log"
May 29 14:02:43.900245 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:43.900216    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ql579_f9d0cd67-e3f9-4d13-867c-e87844047b23/serve-healthcheck-canary/0.log"
May 29 14:02:44.465692 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:44.465664    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5dj6_3e371f92-ce6d-492d-9c6e-755bdde06cb0/kube-rbac-proxy/0.log"
May 29 14:02:44.496670 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:44.496642    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5dj6_3e371f92-ce6d-492d-9c6e-755bdde06cb0/exporter/0.log"
May 29 14:02:44.521278 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:44.521249    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v5dj6_3e371f92-ce6d-492d-9c6e-755bdde06cb0/extractor/0.log"
May 29 14:02:46.574999 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:46.574971    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-b886db694-c5hvr_ca6b3bf2-636e-49f2-ac89-b2834275c528/nginx/0.log"
May 29 14:02:46.927814 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:46.927728    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-vkdjm_80aff121-eb55-4a11-af68-f04aef180345/manager/0.log"
May 29 14:02:46.947209 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:46.947192    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf69667cd-vkdjm_80aff121-eb55-4a11-af68-f04aef180345/copy-manifests/0.log"
May 29 14:02:47.486977 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:47.486949    2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mcwqr/perf-node-gather-daemonset-8vqc9"
May 29 14:02:48.442179 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:48.442138    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-699cb996b8-hqvxf_8340e020-54df-4a67-8a39-4221babaaa6b/manager/0.log"
May 29 14:02:53.512979 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:53.512941    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-cmknx_1c5e3556-46e8-403b-a919-2359d384804a/migrator/0.log"
May 29 14:02:53.559212 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:53.559179    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-cmknx_1c5e3556-46e8-403b-a919-2359d384804a/graceful-termination/0.log"
May 29 14:02:54.007077 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:54.007000    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-5ztml_5362786f-0b9b-4f04-8121-1939048ab401/kube-storage-version-migrator-operator/1.log"
May 29 14:02:54.008811 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:54.008765    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-5ztml_5362786f-0b9b-4f04-8121-1939048ab401/kube-storage-version-migrator-operator/0.log"
May 29 14:02:55.257251 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.257225    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/kube-multus-additional-cni-plugins/0.log"
May 29 14:02:55.276398 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.276378    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/egress-router-binary-copy/0.log"
May 29 14:02:55.295214 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.295194    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/cni-plugins/0.log"
May 29 14:02:55.314546 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.314522    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/bond-cni-plugin/0.log"
May 29 14:02:55.334582 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.334539    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/routeoverride-cni/0.log"
May 29 14:02:55.355764 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.355743    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/whereabouts-cni-bincopy/0.log"
May 29 14:02:55.376173 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.376152    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nvs5_11ab91de-aef3-4293-bfd0-74bf04f873d3/whereabouts-cni/0.log"
May 29 14:02:55.557895 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.557865    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n8dlm_c23ab90e-66ad-44d8-ac19-b71a61648930/kube-multus/0.log"
May 29 14:02:55.578045 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.578018    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6dspt_1879625a-c0e3-45ef-a577-3261d2afd611/network-metrics-daemon/0.log"
May 29 14:02:55.598019 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:55.597998    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6dspt_1879625a-c0e3-45ef-a577-3261d2afd611/kube-rbac-proxy/0.log"
May 29 14:02:56.566389 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.566362    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-controller/0.log"
May 29 14:02:56.583585 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.583529    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/0.log"
May 29 14:02:56.589149 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.589130    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovn-acl-logging/1.log"
May 29 14:02:56.607120 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.607094    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/kube-rbac-proxy-node/0.log"
May 29 14:02:56.628328 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.628302    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/kube-rbac-proxy-ovn-metrics/0.log"
May 29 14:02:56.650507 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.650482    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/northd/0.log"
May 29 14:02:56.671470 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.671440    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/nbdb/0.log"
May 29 14:02:56.693427 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.693399    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/sbdb/0.log"
May 29 14:02:56.789976 ip-10-0-139-221 kubenswrapper[2549]: I0529 14:02:56.789947    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bthnm_53b0eb66-6444-4922-ada3-55376f15e9d3/ovnkube-controller/0.log"