Jun 11 21:43:11.812070 ip-10-0-141-164 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:43:12.233388 ip-10-0-141-164 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:43:12.233388 ip-10-0-141-164 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:43:12.233388 ip-10-0-141-164 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:43:12.233388 ip-10-0-141-164 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:43:12.233388 ip-10-0-141-164 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:43:12.235520 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.235428 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:43:12.239066 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239044 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.239066 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239062 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.239066 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239067 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.239066 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239071 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239076 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239080 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239084 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239087 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239092 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239095 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239099 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239103 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239111 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239115 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239119 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239123 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239127 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239131 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239135 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239139 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239143 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239147 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.239296 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239152 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239156 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239159 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239164 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239168 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239172 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239176 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239180 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239184 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239188 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239192 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239197 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239201 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239205 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239209 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239214 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239218 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239222 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239227 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239231 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.240093 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239235 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239240 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239244 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239249 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239253 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239257 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239261 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239266 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239270 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239274 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239279 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239283 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239288 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239292 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239296 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239300 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239304 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239308 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239313 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239317 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.240961 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239321 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239325 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239332 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239339 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239345 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239350 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239355 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239360 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239365 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239369 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239374 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239378 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239383 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239387 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239393 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239397 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239401 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239406 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239410 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.241798 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239415 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239420 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239424 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239428 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239433 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239439 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239446 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239451 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239456 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239460 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239466 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239470 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239475 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239479 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239485 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239491 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239496 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.239501 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240697 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.242594 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240706 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240712 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240716 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240721 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240726 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240730 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240734 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240738 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240742 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240747 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240752 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240756 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240761 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240766 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240770 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240774 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240778 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240782 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240786 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240790 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.243481 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240794 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240799 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240803 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240807 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240811 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240815 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240819 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240824 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240828 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240832 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240836 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240840 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240844 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240849 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240853 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240857 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240862 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240866 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240870 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240874 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.244209 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240878 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240882 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240886 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240891 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240895 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240900 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240904 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240908 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240912 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240917 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240920 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240924 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240928 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240933 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240937 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240941 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240945 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240949 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240954 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240959 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.244792 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240965 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240969 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240973 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240977 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240982 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240987 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240993 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.240997 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241002 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241006 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241015 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241020 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241024 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241028 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241032 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241036 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241041 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241045 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241050 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241054 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.245432 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241058 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241062 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241069 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241074 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241081 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241088 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241094 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241099 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241103 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241108 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241112 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241116 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241121 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241125 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241129 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241134 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241138 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241143 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241751 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.246017 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241760 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241765 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241770 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241775 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241781 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241785 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241789 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241794 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241799 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241802 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241806 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241810 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241817 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241823 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241828 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241833 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241837 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241842 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241847 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.246502 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241851 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241856 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241861 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241865 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241869 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241874 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241878 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241883 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241887 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241891 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241895 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241900 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241905 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241910 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241916 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241921 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241925 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241930 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241935 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241939 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.247077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241943 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241947 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241951 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241955 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241961 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241965 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241969 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241973 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241978 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241982 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241986 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241990 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241995 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.241999 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242003 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242007 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242011 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242015 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242019 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242024 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.247574 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242028 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242032 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242036 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242053 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242058 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242062 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242066 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242070 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242074 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242078 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242087 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242093 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242098 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242102 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242107 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242111 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242116 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242120 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242124 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.248077 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242128 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242132 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242136 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242140 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242144 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242149 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242153 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242157 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242161 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242164 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242169 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242173 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242177 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242181 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242185 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242189 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242195 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242199 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242203 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.242207 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242305 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:43:12.248521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242315 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242324 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242332 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242340 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242345 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242352 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242359 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242364 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242369 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242375 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242379 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242384 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242389 2581 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242393 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242398 2581 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242402 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242407 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242414 2581 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242418 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242423 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242428 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242434 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242440 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:43:12.249051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242445 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242450 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242455 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242460 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242469 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242474 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242479 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242484 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242491 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242496 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242501 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242505 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242510 2581 flags.go:64] FLAG: --enable-server="true" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242516 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242522 2581 flags.go:64] FLAG: --event-burst="100" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242527 2581 flags.go:64] FLAG: --event-qps="50" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242532 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242537 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242542 2581 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242548 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242552 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242557 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242562 2581 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242567 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242572 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:43:12.249592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242576 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242581 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242586 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242590 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242594 2581 flags.go:64] FLAG: --feature-gates="" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242600 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242605 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242610 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242615 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242619 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242624 2581 flags.go:64] FLAG: --help="false" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242630 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242636 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242640 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242645 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242669 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242675 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242680 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242684 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242689 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242693 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242699 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242705 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242710 2581 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:43:12.250341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242715 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242719 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242724 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242729 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242733 2581 flags.go:64] FLAG: --lock-file="" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242738 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242743 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242748 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242756 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242761 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242765 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242770 2581 flags.go:64] FLAG: --logging-format="text" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242775 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242780 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242785 2581 flags.go:64] FLAG: --manifest-url="" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242790 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242797 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242801 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242815 2581 flags.go:64] FLAG: --max-pods="110" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242823 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242828 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242833 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242837 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242843 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242847 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:43:12.250945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242852 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242865 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242870 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242875 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242880 2581 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242885 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242893 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242898 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242903 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242908 2581 flags.go:64] FLAG: --port="10250" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242913 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242917 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd99205b48451a2b" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242922 2581 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242927 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242931 2581 flags.go:64] FLAG: --register-node="true" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242936 2581 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242942 2581 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242946 2581 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242950 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242955 2581 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242961 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242966 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242970 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242978 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242983 2581 flags.go:64] FLAG: --runonce="false" Jun 11 21:43:12.251541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242988 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242994 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.242999 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243004 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243008 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243013 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243018 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243023 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243028 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243033 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243037 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243042 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243046 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243051 2581 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243056 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243064 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243069 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243074 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243081 2581 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243086 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243090 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243095 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243100 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243105 2581 flags.go:64] FLAG: --v="2" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243111 2581 flags.go:64] FLAG: --version="false" Jun 11 21:43:12.252160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243118 2581 flags.go:64] FLAG: --vmodule="" Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243123 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.243128 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243313 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243320 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243327 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243332 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243337 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243343 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243349 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243353 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243357 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243361 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243366 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243370 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243374 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243381 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243386 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243391 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.252783 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243396 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243400 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243405 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243410 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243415 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243419 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243423 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243428 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243434 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243439 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243444 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243449 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243453 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243458 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243462 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243466 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243470 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243475 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243480 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243484 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.253238 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243489 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243497 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243502 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243507 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243511 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243515 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243520 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243524 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243528 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243533 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243537 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243541 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243545 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243549 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243554 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243565 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243570 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243574 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243578 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243582 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.253789 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243586 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243590 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243595 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243599 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243603 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243607 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243611 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243615 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243619 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243623 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243629 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243634 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243638 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243644 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243648 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243671 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243676 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243680 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243684 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.254265 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243688 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243693 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243698 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243702 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243706 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243712 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243716 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243721 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243725 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243730 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243734 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243738 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243742 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243747 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243752 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243756 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243761 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243765 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243769 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243773 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.254746 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243777 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243781 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243786 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.243792 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.244369 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.251792 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.251810 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.252507 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.252514 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252588 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252593 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252597 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252599 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252603 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252605 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.255228 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252608 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252611 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252613 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252616 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252618 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252621 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252623 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252626 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252629 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252631 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252634 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252637 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252639 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252642 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252644 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252647 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252649 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252668 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252672 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252675 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.255596 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252677 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252680 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252682 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252694 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252697 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252700 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252703 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252706 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252708 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252711 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252713 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252716 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252719 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252721 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252724 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252727 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252730 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252732 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252734 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.256097 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252739 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252742 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252745 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252748 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252750 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252753 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252756 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252759 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252762 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252764 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252766 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252769 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252771 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252774 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252776 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252779 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252782 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252791 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252793 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252796 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.256556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252799 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252801 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252804 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252806 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252810 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252813 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252816 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252819 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252821 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252824 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252826 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252829 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252831 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252834 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252836 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252839 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252841 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252844 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252846 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.257059 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252849 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252851 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252854 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252856 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252859 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252861 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252865 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252869 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252871 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252875 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252878 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252886 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252889 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252891 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.257509 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.252894 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.252899 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253059 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253064 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253067 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253070 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253073 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253075 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253078 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253081 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253083 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253086 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253088 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253090 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253094 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:43:12.257876 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253097 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253100 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253103 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253106 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253109 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253112 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253114 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253117 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253120 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253122 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253124 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253127 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253130 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253133 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253135 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253143 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253146 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253148 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253151 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:43:12.258240 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253153 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253156 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253158 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253161 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253164 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253166 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253168 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253171 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253173 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253176 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253178 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253181 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253183 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253186 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253188 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253190 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253193 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253195 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253198 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253200 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:43:12.258709 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253203 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253205 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253208 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253210 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253213 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253216 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253219 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253222 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253224 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253232 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253235 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253238 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253240 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253243 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253245 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253248 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253268 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253272 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253275 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253277 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:43:12.259181 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253280 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253283 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253286 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253288 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253291 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253293 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253295 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253298 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253300 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253303 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253306 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253308 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253311 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253314 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253316 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253318 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253321 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253324 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253326 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253330 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:43:12.259675 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253333 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253336 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253344 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253347 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253349 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253352 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:12.253354 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.253358 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.253488 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.255500 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.256953 2581 server.go:1019] "Starting client certificate rotation" Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.257076 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.257127 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:43:12.260250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.259747 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:43:12.263426 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.263403 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:43:12.274726 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.274709 2581 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:43:12.277632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.277615 2581 log.go:25] "Validated CRI v1 image API" Jun 11 21:43:12.278509 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.278493 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:43:12.283254 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.283235 2581 fs.go:135] Filesystem UUIDs: map[20e5e9fd-c903-44ef-89a7-e36a3e4ecded:/dev/nvme0n1p3 2dd2754d-e686-4930-b3cb-407e31b0b147:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 21:43:12.283305 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.283254 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:43:12.287781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.287669 2581 manager.go:216] Machine: {Timestamp:2026-06-11 21:43:12.287167862 +0000 UTC m=+0.354938989 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099468 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5fa364b238e77e377431aa65233b SystemUUID:ec2e5fa3-64b2-38e7-7e37-7431aa65233b BootID:c651da3e-f533-4e53-ab2c-dd1b74a80a93 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2c:46:a2:73:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2c:46:a2:73:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:03:c5:fe:2b:5e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:43:12.287781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.287777 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:43:12.287885 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.287854 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:43:12.289704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.289679 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:43:12.289882 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.289708 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-164.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:43:12.290124 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.290094 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:43:12.290948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.290933 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:43:12.291009 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.290954 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:43:12.291009 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.290965 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:43:12.291718 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.291706 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:43:12.293015 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.293002 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:43:12.296761 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.296747 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:43:12.296929 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.296917 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:43:12.296986 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.296955 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:43:12.296986 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.296976 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:43:12.297076 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.296996 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:43:12.297076 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.297008 2581 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:43:12.297076 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.297022 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:43:12.297517 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.297502 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:43:12.297592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.297527 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:43:12.300300 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.300283 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:43:12.302945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.302921 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:43:12.303031 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.302971 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:43:12.303785 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303753 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303803 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303815 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303826 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303839 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303845 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303855 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303861 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303869 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303878 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303886 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:43:12.303886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.303892 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:43:12.304700 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.304690 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:43:12.304700 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.304700 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:43:12.309370 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.309350 2581 server.go:1268] "Started kubelet" Jun 11 21:43:12.309455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.309407 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:43:12.309545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.309492 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:43:12.309635 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.309564 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:43:12.310367 ip-10-0-141-164 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:43:12.310935 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.310630 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zrz9m" Jun 11 21:43:12.311306 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.311244 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:43:12.311526 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.311514 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:43:12.312644 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.312618 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-164.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:43:12.312734 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.312677 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:43:12.312734 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.312707 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:43:12.316450 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.316432 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:43:12.316547 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.316452 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:43:12.316547 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.316513 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.317069 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.316984 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:43:12.317258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317240 2581 factory.go:55] Registering systemd factory Jun 11 21:43:12.317258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317260 2581 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:43:12.317552 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317537 2581 factory.go:153] Registering CRI-O factory Jun 11 21:43:12.317622 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317557 2581 factory.go:223] Registration of the crio container factory successfully Jun 11 21:43:12.317622 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317611 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:43:12.317741 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317637 2581 factory.go:103] Registering Raw factory Jun 11 21:43:12.317741 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317733 2581 manager.go:1196] Started watching for new ooms in manager Jun 11 21:43:12.317941 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317924 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:43:12.317994 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.317945 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:43:12.318115 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.318103 2581 manager.go:349] Starting recovery of all containers Jun 11 21:43:12.318176 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.318129 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zrz9m" Jun 11 21:43:12.319420 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.318109 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:43:12.319420 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.319412 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:43:12.319770 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.319742 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:43:12.320004 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.319984 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-164.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:43:12.320167 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.320067 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:43:12.321222 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.320157 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-164.ec2.internal.18b824dee17ab1ee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-164.ec2.internal,UID:ip-10-0-141-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-164.ec2.internal,},FirstTimestamp:2026-06-11 21:43:12.309285358 +0000 UTC m=+0.377056484,LastTimestamp:2026-06-11 21:43:12.309285358 +0000 UTC m=+0.377056484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-164.ec2.internal,}" Jun 11 21:43:12.329398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.329246 2581 manager.go:354] Recovery completed Jun 11 21:43:12.333551 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.333539 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.335155 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335138 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.335243 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335172 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.335243 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335187 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.335668 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335639 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:43:12.335668 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335666 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:43:12.335771 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335686 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:43:12.335771 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.335704 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.336420 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.336404 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.336479 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.336437 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.336479 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.336447 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.336633 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.336567 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-164.ec2.internal.18b824dee3057141 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-164.ec2.internal,UID:ip-10-0-141-164.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-164.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-164.ec2.internal,},FirstTimestamp:2026-06-11 21:43:12.335155521 +0000 UTC m=+0.402926651,LastTimestamp:2026-06-11 21:43:12.335155521 +0000 UTC m=+0.402926651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-164.ec2.internal,}" Jun 11 21:43:12.337784 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.337772 2581 policy_none.go:49] "None policy: Start" Jun 11 21:43:12.337822 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.337794 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:43:12.337822 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.337804 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:43:12.339798 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.339784 2581 policy_none.go:47] "Start" Jun 11 21:43:12.375318 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375297 2581 manager.go:337] "Starting Device Plugin manager" Jun 11 21:43:12.375413 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.375338 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:43:12.375413 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375351 2581 server.go:87] "Starting device plugin registration server" Jun 11 21:43:12.375633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375617 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:43:12.375881 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375633 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:43:12.375881 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375793 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:43:12.375881 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375880 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:43:12.376217 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.375892 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:43:12.376627 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.376594 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:43:12.376735 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.376651 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.388150 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.388129 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:43:12.389365 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.389345 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:43:12.389439 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.389380 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:43:12.389439 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.389398 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:43:12.389439 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.389427 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:43:12.391498 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.391479 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:12.476732 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.476685 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.477852 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.477834 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.477932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.477867 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.477932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.477884 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.477932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.477907 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.483925 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.483882 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.483925 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.483908 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-164.ec2.internal\": node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.490236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.490221 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal"] Jun 11 21:43:12.490291 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.490282 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.491609 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.491593 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.491694 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.491618 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.491694 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.491628 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.493966 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.493955 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.494088 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.494129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494120 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.494594 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494580 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.494677 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494604 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.494677 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494617 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.494745 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494696 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.494745 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494719 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.494745 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.494729 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.496759 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.496744 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.496836 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.496768 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:43:12.497419 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.497399 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.497497 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.497461 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:43:12.497497 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.497489 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:43:12.497497 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.497499 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:43:12.513191 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.513174 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-164.ec2.internal\" not found" node="ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.516980 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.516965 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-164.ec2.internal\" not found" node="ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.520186 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.520164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.520264 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.520192 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.520264 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.520209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1234a3e78b8179c285836e565965a2a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-164.ec2.internal\" (UID: \"1234a3e78b8179c285836e565965a2a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.598376 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.598357 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.620443 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.620497 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620475 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.620526 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.620572 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1234a3e78b8179c285836e565965a2a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-164.ec2.internal\" (UID: \"1234a3e78b8179c285836e565965a2a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.620601 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620567 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1234a3e78b8179c285836e565965a2a2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-164.ec2.internal\" (UID: \"1234a3e78b8179c285836e565965a2a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.620601 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.620587 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e33979ef500a6b59107c7dc42a481b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal\" (UID: \"6e33979ef500a6b59107c7dc42a481b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.698615 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.698575 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.799347 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.799283 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:12.815458 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.815440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.820451 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:12.820436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:12.899937 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:12.899898 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:13.000427 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:13.000392 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:13.100926 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:13.100862 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:13.201171 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:13.201143 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:13.203154 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.203061 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:13.256293 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.256266 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:43:13.256901 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.256425 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:43:13.256901 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.256465 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:43:13.301810 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:13.301781 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-164.ec2.internal\" not found" Jun 11 21:43:13.321834 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.321806 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:13.323986 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.323944 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:38:12 +0000 UTC" deadline="2028-02-20 03:03:42.656662604 +0000 UTC" Jun 11 21:43:13.324045 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.323987 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14837h20m29.332678674s" Jun 11 21:43:13.409221 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:13.409189 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1234a3e78b8179c285836e565965a2a2.slice/crio-01abe03d0e3b0651b7748644495ae9610e636ef7ecd0ac4f73993c21cd522a0c WatchSource:0}: Error finding container 01abe03d0e3b0651b7748644495ae9610e636ef7ecd0ac4f73993c21cd522a0c: Status 404 returned error can't find the container with id 01abe03d0e3b0651b7748644495ae9610e636ef7ecd0ac4f73993c21cd522a0c Jun 11 21:43:13.415888 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.415868 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:43:13.417522 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.417504 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" Jun 11 21:43:13.419855 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:13.419836 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e33979ef500a6b59107c7dc42a481b1.slice/crio-e3c08beebabf7d4ccd601e933321a304d4ff542f31355ffa94bffd18867808ad WatchSource:0}: Error finding container e3c08beebabf7d4ccd601e933321a304d4ff542f31355ffa94bffd18867808ad: Status 404 returned error can't find the container with id e3c08beebabf7d4ccd601e933321a304d4ff542f31355ffa94bffd18867808ad Jun 11 21:43:13.431464 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.431448 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:43:13.432701 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.432687 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" Jun 11 21:43:13.440154 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.440133 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:43:13.872516 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:13.872444 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:14.298202 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.298121 2581 apiserver.go:52] "Watching apiserver" Jun 11 21:43:14.304894 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.304872 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:43:14.306068 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.306030 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-k5th4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l","openshift-cluster-node-tuning-operator/tuned-g87w4","openshift-dns/node-resolver-l9zrf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal","openshift-multus/multus-tg966","openshift-network-diagnostics/network-check-target-pnq2q","kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal","openshift-image-registry/node-ca-9b6d6","openshift-multus/multus-additional-cni-plugins-btxbh","openshift-multus/network-metrics-daemon-4zm4q","openshift-network-operator/iptables-alerter-gxvzv","openshift-ovn-kubernetes/ovnkube-node-bk4q7","kube-system/global-pull-secret-syncer-65tgf"] Jun 11 21:43:14.308485 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.308470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:14.308552 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.308535 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:14.310552 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.310533 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.310623 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.310605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:14.312691 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.312668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.314318 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.314297 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.314421 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.314379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wh8w9\"" Jun 11 21:43:14.315261 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.315240 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.315470 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.315448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.316676 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.316640 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:43:14.317604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.317436 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.317604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.317557 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qjbm7\"" Jun 11 21:43:14.317770 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.317690 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.317962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.317942 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.318049 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.318009 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:14.320082 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.320064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tg966" Jun 11 21:43:14.322424 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.322246 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fds7b\"" Jun 11 21:43:14.322424 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.322333 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:43:14.322554 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.322532 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.325125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.324471 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:43:14.325125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.324488 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.325125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.325095 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.326357 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.326229 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:43:14.326357 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.326244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.326357 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.326301 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.326602 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.326583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m97mx\"" Jun 11 21:43:14.327458 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.327437 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:43:14.328096 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.328079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.329521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.329501 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.329953 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.329936 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.330106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:43:14.330255 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330241 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:43:14.330691 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzmct\"" Jun 11 21:43:14.330691 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330619 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:43:14.330932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:14.330932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-systemd\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.330932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330907 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-run\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-sys\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.330885 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b529c\" (UniqueName: \"kubernetes.io/projected/01827b8f-24b6-4df0-a034-43137093f29b-kube-api-access-b529c\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-kubelet-config\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfrt\" (UniqueName: \"kubernetes.io/projected/889db87a-4683-4dc3-9f77-6f624179cfcd-kube-api-access-9sfrt\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-modprobe-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-kubernetes\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-conf\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-tmp\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysconfig\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-lib-modules\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-host\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/386b7758-2d4f-4e98-bc8a-688929d3e998-tmp-dir\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.331804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7brq\" (UniqueName: \"kubernetes.io/projected/386b7758-2d4f-4e98-bc8a-688929d3e998-kube-api-access-g7brq\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-var-lib-kubelet\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-etc-tuned\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/386b7758-2d4f-4e98-bc8a-688929d3e998-hosts-file\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.331829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-dbus\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.332720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.332515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rmbhf\"" Jun 11 21:43:14.333036 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.332740 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.333036 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.332892 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:43:14.333131 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.333061 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.335933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.335574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.337553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.337520 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:43:14.337906 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.337673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:43:14.337906 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.337860 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pphj9\"" Jun 11 21:43:14.339349 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.339165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.340811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.340752 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:43:14.340811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.340783 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:43:14.340959 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.340858 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tz5pw\"" Jun 11 21:43:14.341260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.341207 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.343033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.343017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:43:14.343160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.343051 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:43:14.343309 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.343270 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qths2\"" Jun 11 21:43:14.343419 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.343382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:43:14.352815 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.352784 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-794gr" Jun 11 21:43:14.361392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.361377 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-794gr" Jun 11 21:43:14.396776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.396735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" event={"ID":"6e33979ef500a6b59107c7dc42a481b1","Type":"ContainerStarted","Data":"e3c08beebabf7d4ccd601e933321a304d4ff542f31355ffa94bffd18867808ad"} Jun 11 21:43:14.397948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.397926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" event={"ID":"1234a3e78b8179c285836e565965a2a2","Type":"ContainerStarted","Data":"01abe03d0e3b0651b7748644495ae9610e636ef7ecd0ac4f73993c21cd522a0c"} Jun 11 21:43:14.417806 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.417787 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:43:14.432770 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-etc-kubernetes\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.432872 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-netns\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.432872 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.432945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjfgp\" (UniqueName: \"kubernetes.io/projected/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kube-api-access-fjfgp\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.432945 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-host\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-multus-daemon-config\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.433006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.432980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-netd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-script-lib\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-system-cni-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433031 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-host\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-multus-certs\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-systemd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-var-lib-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8e6a01f-41c0-4655-8d69-a619baad3359-ovn-node-metrics-cert\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c80a5a83-9eb4-47cf-b4a9-384710317179-iptables-alerter-script\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433218 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-run\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433242 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b529c\" (UniqueName: \"kubernetes.io/projected/01827b8f-24b6-4df0-a034-43137093f29b-kube-api-access-b529c\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-systemd-units\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.433286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cnibin\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-run\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldhd\" (UniqueName: \"kubernetes.io/projected/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-kube-api-access-hldhd\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-conf\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.433529 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da4b4611-50bd-48e4-91e7-3d724f3159d4-host\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.433606 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:14.933586611 +0000 UTC m=+3.001357738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysconfig\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.433632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433627 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-conf\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysctl-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-lib-modules\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7brq\" (UniqueName: \"kubernetes.io/projected/386b7758-2d4f-4e98-bc8a-688929d3e998-kube-api-access-g7brq\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433688 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-sysconfig\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433699 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-sys-fs\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-var-lib-kubelet\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/386b7758-2d4f-4e98-bc8a-688929d3e998-hosts-file\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-dbus\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-system-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433790 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-lib-modules\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-bin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433818 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-var-lib-kubelet\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-kubelet\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/386b7758-2d4f-4e98-bc8a-688929d3e998-hosts-file\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclct\" (UniqueName: \"kubernetes.io/projected/a8e6a01f-41c0-4655-8d69-a619baad3359-kube-api-access-gclct\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433887 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f4cj\" (UniqueName: \"kubernetes.io/projected/da4b4611-50bd-48e4-91e7-3d724f3159d4-kube-api-access-8f4cj\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.434220 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-dbus\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-systemd\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-sys\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-bin\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-env-overrides\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-systemd\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.433988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-konnectivity-ca\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434098 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-sys\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfrt\" (UniqueName: \"kubernetes.io/projected/889db87a-4683-4dc3-9f77-6f624179cfcd-kube-api-access-9sfrt\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-etc-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-config\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da4b4611-50bd-48e4-91e7-3d724f3159d4-serviceca\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434215 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-log-socket\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-socket-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.435010 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-k8s-cni-cncf-io\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434307 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-slash\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-ovn\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.434341 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434370 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c80a5a83-9eb4-47cf-b4a9-384710317179-host-slash\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.434458 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:14.934445693 +0000 UTC m=+3.002216805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-kubelet-config\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434622 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e5123d9-bf98-4743-9157-eca3ab0a2be4-kubelet-config\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-agent-certs\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434700 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzxt6\" (UniqueName: \"kubernetes.io/projected/c80a5a83-9eb4-47cf-b4a9-384710317179-kube-api-access-qzxt6\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-modprobe-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434751 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-kubernetes\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-tmp\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.435865 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-multus\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vf5v\" (UniqueName: \"kubernetes.io/projected/364332cd-a702-443e-ab66-63584920b879-kube-api-access-9vf5v\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434834 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-kubernetes\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434842 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01827b8f-24b6-4df0-a034-43137093f29b-etc-modprobe-d\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-node-log\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/386b7758-2d4f-4e98-bc8a-688929d3e998-tmp-dir\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-cnibin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.434976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-netns\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-kubelet\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-hostroot\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-conf-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-etc-tuned\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435163 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435159 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-registration-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435219 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-device-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-cni-binary-copy\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.436721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-os-release\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.437631 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/386b7758-2d4f-4e98-bc8a-688929d3e998-tmp-dir\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.437631 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-os-release\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.437631 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.435315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-socket-dir-parent\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.438532 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.438507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-etc-tuned\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.438532 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.438523 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01827b8f-24b6-4df0-a034-43137093f29b-tmp\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.441429 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.441410 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:14.441520 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.441436 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:14.441520 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.441448 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:14.441520 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.441501 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:14.941485862 +0000 UTC m=+3.009256996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:14.442717 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.442640 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b529c\" (UniqueName: \"kubernetes.io/projected/01827b8f-24b6-4df0-a034-43137093f29b-kube-api-access-b529c\") pod \"tuned-g87w4\" (UID: \"01827b8f-24b6-4df0-a034-43137093f29b\") " pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.442800 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.442765 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfrt\" (UniqueName: \"kubernetes.io/projected/889db87a-4683-4dc3-9f77-6f624179cfcd-kube-api-access-9sfrt\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.442800 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.442784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7brq\" (UniqueName: \"kubernetes.io/projected/386b7758-2d4f-4e98-bc8a-688929d3e998-kube-api-access-g7brq\") pod \"node-resolver-l9zrf\" (UID: \"386b7758-2d4f-4e98-bc8a-688929d3e998\") " pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.536403 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-system-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.536403 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536411 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-bin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-kubelet\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536458 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclct\" (UniqueName: \"kubernetes.io/projected/a8e6a01f-41c0-4655-8d69-a619baad3359-kube-api-access-gclct\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f4cj\" (UniqueName: \"kubernetes.io/projected/da4b4611-50bd-48e4-91e7-3d724f3159d4-kube-api-access-8f4cj\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-bin\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-env-overrides\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-system-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536540 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-konnectivity-ca\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.536627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-etc-selinux\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-etc-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-config\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da4b4611-50bd-48e4-91e7-3d724f3159d4-serviceca\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-log-socket\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-socket-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-k8s-cni-cncf-io\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-slash\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536837 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-ovn\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c80a5a83-9eb4-47cf-b4a9-384710317179-host-slash\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-agent-certs\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzxt6\" (UniqueName: \"kubernetes.io/projected/c80a5a83-9eb4-47cf-b4a9-384710317179-kube-api-access-qzxt6\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.536961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-multus\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vf5v\" (UniqueName: \"kubernetes.io/projected/364332cd-a702-443e-ab66-63584920b879-kube-api-access-9vf5v\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.536994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-node-log\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-cnibin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-netns\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-kubelet\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-hostroot\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537088 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-conf-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-registration-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-device-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-cni-binary-copy\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-os-release\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-os-release\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-socket-dir-parent\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-etc-kubernetes\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-konnectivity-ca\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-netns\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.537633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfgp\" (UniqueName: \"kubernetes.io/projected/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kube-api-access-fjfgp\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537351 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-etc-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-multus-daemon-config\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-bin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-kubelet\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537951 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-cni-multus\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-node-log\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-cnibin\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538076 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-netns\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-var-lib-kubelet\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-hostroot\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-conf-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.538380 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-bin\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.538892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.538892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538671 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-registration-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.538892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538720 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-device-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.538892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.538793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-env-overrides\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539059 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539044 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-cni-binary-copy\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539124 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-os-release\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539166 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539149 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-os-release\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539198 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-socket-dir-parent\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539245 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539213 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-etc-kubernetes\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539245 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-config\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539245 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.537354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/364332cd-a702-443e-ab66-63584920b879-multus-daemon-config\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539350 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-netd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539350 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-script-lib\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539350 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539314 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-system-cni-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c80a5a83-9eb4-47cf-b4a9-384710317179-host-slash\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-multus-certs\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-systemd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-var-lib-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8e6a01f-41c0-4655-8d69-a619baad3359-ovn-node-metrics-cert\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c80a5a83-9eb4-47cf-b4a9-384710317179-iptables-alerter-script\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-systemd-units\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539598 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cnibin\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539647 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldhd\" (UniqueName: \"kubernetes.io/projected/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-kube-api-access-hldhd\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da4b4611-50bd-48e4-91e7-3d724f3159d4-host\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-sys-fs\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.539793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539760 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da4b4611-50bd-48e4-91e7-3d724f3159d4-serviceca\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.540260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-ovn\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.539899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-var-lib-openvswitch\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540104 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-run-netns\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540501 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-run-systemd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540501 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-system-cni-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.540501 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-cni-netd\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.540642 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540588 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-multus-cni-dir\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.541000 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.540969 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a8e6a01f-41c0-4655-8d69-a619baad3359-ovnkube-script-lib\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.541096 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541023 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da4b4611-50bd-48e4-91e7-3d724f3159d4-host\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.541096 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541062 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.541193 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541113 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.541193 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541160 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-sys-fs\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.541286 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-k8s-cni-cncf-io\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.541340 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca9211e0-f275-4dec-8e74-c2d6d16b4418-socket-dir\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.541340 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541318 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-log-socket\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.541414 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/364332cd-a702-443e-ab66-63584920b879-host-run-multus-certs\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.541414 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-host-slash\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.541479 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c80a5a83-9eb4-47cf-b4a9-384710317179-iptables-alerter-script\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.541511 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a8e6a01f-41c0-4655-8d69-a619baad3359-systemd-units\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.541548 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cnibin\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.541791 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.541753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.542149 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.542128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-cni-binary-copy\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.542518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.542498 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a8e6a01f-41c0-4655-8d69-a619baad3359-ovn-node-metrics-cert\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.544166 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.544124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64-agent-certs\") pod \"konnectivity-agent-k5th4\" (UID: \"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64\") " pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.545516 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.545492 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f4cj\" (UniqueName: \"kubernetes.io/projected/da4b4611-50bd-48e4-91e7-3d724f3159d4-kube-api-access-8f4cj\") pod \"node-ca-9b6d6\" (UID: \"da4b4611-50bd-48e4-91e7-3d724f3159d4\") " pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.545701 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.545618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfgp\" (UniqueName: \"kubernetes.io/projected/ca9211e0-f275-4dec-8e74-c2d6d16b4418-kube-api-access-fjfgp\") pod \"aws-ebs-csi-driver-node-jgx5l\" (UID: \"ca9211e0-f275-4dec-8e74-c2d6d16b4418\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.545701 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.545639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclct\" (UniqueName: \"kubernetes.io/projected/a8e6a01f-41c0-4655-8d69-a619baad3359-kube-api-access-gclct\") pod \"ovnkube-node-bk4q7\" (UID: \"a8e6a01f-41c0-4655-8d69-a619baad3359\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.545874 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.545864 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzxt6\" (UniqueName: \"kubernetes.io/projected/c80a5a83-9eb4-47cf-b4a9-384710317179-kube-api-access-qzxt6\") pod \"iptables-alerter-gxvzv\" (UID: \"c80a5a83-9eb4-47cf-b4a9-384710317179\") " pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.546835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.546815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vf5v\" (UniqueName: \"kubernetes.io/projected/364332cd-a702-443e-ab66-63584920b879-kube-api-access-9vf5v\") pod \"multus-tg966\" (UID: \"364332cd-a702-443e-ab66-63584920b879\") " pod="openshift-multus/multus-tg966" Jun 11 21:43:14.547518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.547483 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldhd\" (UniqueName: \"kubernetes.io/projected/e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7-kube-api-access-hldhd\") pod \"multus-additional-cni-plugins-btxbh\" (UID: \"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7\") " pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.603853 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.603769 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:14.627456 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.627425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g87w4" Jun 11 21:43:14.635735 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.635714 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l9zrf" Jun 11 21:43:14.645592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.645571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tg966" Jun 11 21:43:14.655211 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.655193 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b6d6" Jun 11 21:43:14.662199 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.662181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:14.670007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.669991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" Jun 11 21:43:14.677583 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.677553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-btxbh" Jun 11 21:43:14.684262 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.684239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:14.690928 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.690911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxvzv" Jun 11 21:43:14.941633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.941557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:14.941633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.941604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:14.941633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:14.941627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941736 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941765 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941772 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941800 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941809 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:15.941793631 +0000 UTC m=+4.009564744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941811 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941854 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:15.941836146 +0000 UTC m=+4.009607279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:14.941880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:14.941876 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:15.941864489 +0000 UTC m=+4.009635608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:15.130417 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.130385 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:43:15.364688 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.364618 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:38:14 +0000 UTC" deadline="2028-03-04 05:31:05.722540974 +0000 UTC" Jun 11 21:43:15.364688 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.364683 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15151h47m50.357862154s" Jun 11 21:43:15.365395 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.364935 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e6a01f_41c0_4655_8d69_a619baad3359.slice/crio-127a4874f8a53b545b891e57be864b12bcccf4f8bcb938936803bc4e9932bca9 WatchSource:0}: Error finding container 127a4874f8a53b545b891e57be864b12bcccf4f8bcb938936803bc4e9932bca9: Status 404 returned error can't find the container with id 127a4874f8a53b545b891e57be864b12bcccf4f8bcb938936803bc4e9932bca9 Jun 11 21:43:15.366786 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.366534 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386b7758_2d4f_4e98_bc8a_688929d3e998.slice/crio-7ae04784286876c8db2f2431ae2fb888b2d907b48ce75feb35e9ee594dda10db WatchSource:0}: Error finding container 7ae04784286876c8db2f2431ae2fb888b2d907b48ce75feb35e9ee594dda10db: Status 404 returned error can't find the container with id 7ae04784286876c8db2f2431ae2fb888b2d907b48ce75feb35e9ee594dda10db Jun 11 21:43:15.367866 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.367186 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6333fc_dfc3_4d00_b2f8_8e49c5dfed64.slice/crio-7c4198f73927fc5c783118f69fc44cdb6f58264dc8875fd5af0b2092ae59e999 WatchSource:0}: Error finding container 7c4198f73927fc5c783118f69fc44cdb6f58264dc8875fd5af0b2092ae59e999: Status 404 returned error can't find the container with id 7c4198f73927fc5c783118f69fc44cdb6f58264dc8875fd5af0b2092ae59e999 Jun 11 21:43:15.368008 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.367867 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4b4611_50bd_48e4_91e7_3d724f3159d4.slice/crio-062e625e92133be907720335a4575765f43f3f19b0d510626234a4e4f6bff28d WatchSource:0}: Error finding container 062e625e92133be907720335a4575765f43f3f19b0d510626234a4e4f6bff28d: Status 404 returned error can't find the container with id 062e625e92133be907720335a4575765f43f3f19b0d510626234a4e4f6bff28d Jun 11 21:43:15.370551 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.370535 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bc00a4_4aa5_48b1_b94d_6afe34ddc2b7.slice/crio-6acd9f8d80c2f2e2dc236382641fe4ee3c3da9021b2114623c093907a67bdfd2 WatchSource:0}: Error finding container 6acd9f8d80c2f2e2dc236382641fe4ee3c3da9021b2114623c093907a67bdfd2: Status 404 returned error can't find the container with id 6acd9f8d80c2f2e2dc236382641fe4ee3c3da9021b2114623c093907a67bdfd2 Jun 11 21:43:15.371993 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.371976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80a5a83_9eb4_47cf_b4a9_384710317179.slice/crio-87d3af7d5a102a572cacc79a25611d1a6ea7a66b06d307222a86191de0b8e5b5 WatchSource:0}: Error finding container 87d3af7d5a102a572cacc79a25611d1a6ea7a66b06d307222a86191de0b8e5b5: Status 404 returned error can't find the container with id 87d3af7d5a102a572cacc79a25611d1a6ea7a66b06d307222a86191de0b8e5b5 Jun 11 21:43:15.373549 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.373143 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364332cd_a702_443e_ab66_63584920b879.slice/crio-52ecb6431bbb77235b4a2eaa62fe97624de6de4068b2309a37fb93db46a029a4 WatchSource:0}: Error finding container 52ecb6431bbb77235b4a2eaa62fe97624de6de4068b2309a37fb93db46a029a4: Status 404 returned error can't find the container with id 52ecb6431bbb77235b4a2eaa62fe97624de6de4068b2309a37fb93db46a029a4 Jun 11 21:43:15.375381 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.375361 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01827b8f_24b6_4df0_a034_43137093f29b.slice/crio-708d44ed27257dd9ac3be4b2759df386594cc5602b249ec3965dd358711524f8 WatchSource:0}: Error finding container 708d44ed27257dd9ac3be4b2759df386594cc5602b249ec3965dd358711524f8: Status 404 returned error can't find the container with id 708d44ed27257dd9ac3be4b2759df386594cc5602b249ec3965dd358711524f8 Jun 11 21:43:15.376600 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:15.376580 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9211e0_f275_4dec_8e74_c2d6d16b4418.slice/crio-f22ad739c048876a0967f056a1138fa39cfdfc5c9d1f3a849a19002d2d4a2c7f WatchSource:0}: Error finding container f22ad739c048876a0967f056a1138fa39cfdfc5c9d1f3a849a19002d2d4a2c7f: Status 404 returned error can't find the container with id f22ad739c048876a0967f056a1138fa39cfdfc5c9d1f3a849a19002d2d4a2c7f Jun 11 21:43:15.400968 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.400778 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b6d6" event={"ID":"da4b4611-50bd-48e4-91e7-3d724f3159d4","Type":"ContainerStarted","Data":"062e625e92133be907720335a4575765f43f3f19b0d510626234a4e4f6bff28d"} Jun 11 21:43:15.402316 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.402282 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l9zrf" event={"ID":"386b7758-2d4f-4e98-bc8a-688929d3e998","Type":"ContainerStarted","Data":"7ae04784286876c8db2f2431ae2fb888b2d907b48ce75feb35e9ee594dda10db"} Jun 11 21:43:15.404824 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.404791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"127a4874f8a53b545b891e57be864b12bcccf4f8bcb938936803bc4e9932bca9"} Jun 11 21:43:15.407983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.407960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g87w4" event={"ID":"01827b8f-24b6-4df0-a034-43137093f29b","Type":"ContainerStarted","Data":"708d44ed27257dd9ac3be4b2759df386594cc5602b249ec3965dd358711524f8"} Jun 11 21:43:15.411195 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.411174 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tg966" event={"ID":"364332cd-a702-443e-ab66-63584920b879","Type":"ContainerStarted","Data":"52ecb6431bbb77235b4a2eaa62fe97624de6de4068b2309a37fb93db46a029a4"} Jun 11 21:43:15.414424 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.414397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerStarted","Data":"6acd9f8d80c2f2e2dc236382641fe4ee3c3da9021b2114623c093907a67bdfd2"} Jun 11 21:43:15.415836 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.415801 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" event={"ID":"ca9211e0-f275-4dec-8e74-c2d6d16b4418","Type":"ContainerStarted","Data":"f22ad739c048876a0967f056a1138fa39cfdfc5c9d1f3a849a19002d2d4a2c7f"} Jun 11 21:43:15.417245 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.417214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxvzv" event={"ID":"c80a5a83-9eb4-47cf-b4a9-384710317179","Type":"ContainerStarted","Data":"87d3af7d5a102a572cacc79a25611d1a6ea7a66b06d307222a86191de0b8e5b5"} Jun 11 21:43:15.418773 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.418753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k5th4" event={"ID":"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64","Type":"ContainerStarted","Data":"7c4198f73927fc5c783118f69fc44cdb6f58264dc8875fd5af0b2092ae59e999"} Jun 11 21:43:15.949052 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.948972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:15.949052 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.949046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:15.949270 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:15.949087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:15.949270 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949199 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:15.949270 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949255 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:17.949237308 +0000 UTC m=+6.017008424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:15.949682 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949631 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:15.949682 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949671 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:15.949682 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949684 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:15.949863 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949727 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:17.949712764 +0000 UTC m=+6.017483884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:15.949863 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949788 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:15.949863 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:15.949816 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:17.949806572 +0000 UTC m=+6.017577687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:16.365777 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.365684 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:38:14 +0000 UTC" deadline="2028-01-07 22:33:17.085003004 +0000 UTC" Jun 11 21:43:16.365777 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.365726 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13800h50m0.719281073s" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.392214 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:16.392401 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.392808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:16.392912 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.392980 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:16.393089 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:16.393044 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:16.439115 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.439077 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e33979ef500a6b59107c7dc42a481b1" containerID="d6db6013128e29d10e54dff7af23a0870463a87adb752f632e68be4497d9644f" exitCode=0 Jun 11 21:43:16.439296 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.439191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" event={"ID":"6e33979ef500a6b59107c7dc42a481b1","Type":"ContainerDied","Data":"d6db6013128e29d10e54dff7af23a0870463a87adb752f632e68be4497d9644f"} Jun 11 21:43:16.453704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:16.453059 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" event={"ID":"1234a3e78b8179c285836e565965a2a2","Type":"ContainerStarted","Data":"568c33fe7f7d64ee667b8103a34717a4cf88aaf361fed628bb793493cd67bde2"} Jun 11 21:43:17.466764 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.466719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" event={"ID":"6e33979ef500a6b59107c7dc42a481b1","Type":"ContainerStarted","Data":"1b46460e9223ca5bf32293a69672bad531e4fa97ce02bbbfc1d35ef44db33313"} Jun 11 21:43:17.479617 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.479565 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-164.ec2.internal" podStartSLOduration=4.479545669 podStartE2EDuration="4.479545669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:17.478839044 +0000 UTC m=+5.546610176" watchObservedRunningTime="2026-06-11 21:43:17.479545669 +0000 UTC m=+5.547316805" Jun 11 21:43:17.479853 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.479823 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-164.ec2.internal" podStartSLOduration=4.479815 podStartE2EDuration="4.479815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:16.46551615 +0000 UTC m=+4.533287283" watchObservedRunningTime="2026-06-11 21:43:17.479815 +0000 UTC m=+5.547586136" Jun 11 21:43:17.965812 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.965776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:17.965983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.965856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:17.965983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:17.965901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:17.966064 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966018 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:17.966109 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966083 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:21.966064902 +0000 UTC m=+10.033836019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:17.966183 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966170 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:17.966214 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966192 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:17.966214 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966204 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:17.966282 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966238 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:21.966227133 +0000 UTC m=+10.033998251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:17.966316 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966295 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:17.966344 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:17.966325 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:21.966315387 +0000 UTC m=+10.034086506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:18.390861 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:18.390713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:18.390861 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:18.390740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:18.390861 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:18.390787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:18.390861 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:18.390851 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:18.391214 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:18.390976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:18.391214 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:18.391050 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:20.391239 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:20.390734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:20.391239 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:20.390883 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:20.391239 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:20.390741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:20.391239 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:20.391191 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:20.391844 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:20.391343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:20.391844 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:20.391446 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.007173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.007230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.007310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007319 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007383 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:30.007365528 +0000 UTC m=+18.075136661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007395 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007427 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:30.00741651 +0000 UTC m=+18.075187623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007497 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007513 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007525 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:22.007586 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.007558 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:30.00754757 +0000 UTC m=+18.075318684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:22.394689 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.394592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:22.394821 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.394705 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:22.395019 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.395003 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:22.395083 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.395069 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:22.395132 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:22.395121 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:22.395206 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:22.395192 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:24.390401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:24.390456 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:24.390470 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:24.390591 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:24.390677 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:24.390997 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:24.390715 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:26.390616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:26.390574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:26.391049 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:26.390735 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:26.391150 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:26.391129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:26.391245 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:26.391227 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:26.391414 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:26.391392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:26.391516 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:26.391497 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:28.390305 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:28.390272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:28.390765 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:28.390272 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:28.390765 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:28.390406 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:28.390765 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:28.390276 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:28.390765 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:28.390485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:28.390765 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:28.390529 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:30.063566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.063524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:30.063566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.063576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063689 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063715 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063755 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:46.063735828 +0000 UTC m=+34.131506962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:43:46.063766564 +0000 UTC m=+34.131537699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.063777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063856 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063876 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063888 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:30.064060 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.063926 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:46.063914131 +0000 UTC m=+34.131685249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:30.390407 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.390328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:30.390567 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.390334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:30.390567 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.390459 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:30.390567 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.390547 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:30.390725 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:30.390334 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:30.390725 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:30.390636 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:32.390561 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:32.390533 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:32.390988 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:32.390628 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:32.390988 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:32.390715 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:32.390988 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:32.390824 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:32.390988 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:32.390868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:32.390988 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:32.390935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:34.390550 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:34.390419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:34.390550 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:34.390505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:34.391006 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:34.390618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:34.391114 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:34.391065 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:34.391199 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:34.391166 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:34.391317 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:34.391298 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:35.511900 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.511498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" event={"ID":"ca9211e0-f275-4dec-8e74-c2d6d16b4418","Type":"ContainerStarted","Data":"8481148c997d5319c98913021f43088cd5e02185baf0c84771f09730d603ce27"} Jun 11 21:43:35.513094 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.513067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k5th4" event={"ID":"bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64","Type":"ContainerStarted","Data":"f8e1a38e3999b9b85e1fd8a56f76a15fb3121997c675519a256e9d92ac564002"} Jun 11 21:43:35.514629 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.514601 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b6d6" event={"ID":"da4b4611-50bd-48e4-91e7-3d724f3159d4","Type":"ContainerStarted","Data":"711e03e86d9eba796389bfcee7c7ade65d9699a565bebc9ab6054609948018a6"} Jun 11 21:43:35.516306 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.516283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l9zrf" event={"ID":"386b7758-2d4f-4e98-bc8a-688929d3e998","Type":"ContainerStarted","Data":"f19145ad4a54877d50d23e343518b7ccbb23857960198f93092f26c8be0b0772"} Jun 11 21:43:35.519227 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519205 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:43:35.519627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519601 2581 generic.go:356] "Generic (PLEG): container finished" podID="a8e6a01f-41c0-4655-8d69-a619baad3359" containerID="e0981060a3af45f4340b3df493b20309bda5961dab5e167486341091fae20723" exitCode=1 Jun 11 21:43:35.519746 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519695 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"21f11eaf4452ec08bc426da6fbe8e94b0291171396840b59b8d5fe94c2c602e5"} Jun 11 21:43:35.519810 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"7165bf0eb37891d09b0cf0459ae7964f264e8d7d23a3d8640f5e6a5131c069ea"} Jun 11 21:43:35.519866 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519823 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"98d69dbee355365b96cffb9269e4610bde9c4d80fdd45f652b49b31c61d48718"} Jun 11 21:43:35.519916 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519872 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"a288dee35e33cdedfac0188af057e0582e3d151e55798576be64858e126baaf6"} Jun 11 21:43:35.519969 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerDied","Data":"e0981060a3af45f4340b3df493b20309bda5961dab5e167486341091fae20723"} Jun 11 21:43:35.520024 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.519974 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"eecc1f0abbf8d7582c8ff2309e3460c60336dd381e1b15c83e6b345dc2a85e43"} Jun 11 21:43:35.521861 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.521836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g87w4" event={"ID":"01827b8f-24b6-4df0-a034-43137093f29b","Type":"ContainerStarted","Data":"7e272ad0366db04ebeae0889091aac63810a6bc3e672452dd9baed50001a307f"} Jun 11 21:43:35.523413 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.523395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tg966" event={"ID":"364332cd-a702-443e-ab66-63584920b879","Type":"ContainerStarted","Data":"82dfe04e4ac72c33f959e48f0201a893cf7253cf5646be30fe4bcd7c533ea053"} Jun 11 21:43:35.525709 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.525638 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k5th4" podStartSLOduration=4.565946013 podStartE2EDuration="23.52562146s" totalImagesPullingTime="18.959675447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:35.525401223 +0000 UTC m=+23.593172361" watchObservedRunningTime="2026-06-11 21:43:35.52562146 +0000 UTC m=+23.593392597" Jun 11 21:43:35.525898 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.525874 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="de8decee7c3194fe9694a2194f74d84c747c9026bfa2fe1c0c40b1cbe7ddd869" exitCode=0 Jun 11 21:43:35.525963 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.525911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"de8decee7c3194fe9694a2194f74d84c747c9026bfa2fe1c0c40b1cbe7ddd869"} Jun 11 21:43:35.553765 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.553722 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g87w4" podStartSLOduration=4.59581656 podStartE2EDuration="23.553707145s" totalImagesPullingTime="18.957890585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:35.539968931 +0000 UTC m=+23.607740069" watchObservedRunningTime="2026-06-11 21:43:35.553707145 +0000 UTC m=+23.621478257" Jun 11 21:43:35.553895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.553877 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tg966" podStartSLOduration=4.572031153 podStartE2EDuration="23.553871059s" totalImagesPullingTime="18.981839906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:35.553684192 +0000 UTC m=+23.621455324" watchObservedRunningTime="2026-06-11 21:43:35.553871059 +0000 UTC m=+23.621642194" Jun 11 21:43:35.565604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.565563 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9b6d6" podStartSLOduration=12.983497522 podStartE2EDuration="23.565551442s" totalImagesPullingTime="10.58205392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:35.565032401 +0000 UTC m=+23.632803536" watchObservedRunningTime="2026-06-11 21:43:35.565551442 +0000 UTC m=+23.633322605" Jun 11 21:43:35.576677 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.576618 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l9zrf" podStartSLOduration=4.616588676 podStartE2EDuration="23.576610076s" totalImagesPullingTime="18.9600214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:35.576428878 +0000 UTC m=+23.644200012" watchObservedRunningTime="2026-06-11 21:43:35.576610076 +0000 UTC m=+23.644381212" Jun 11 21:43:35.638971 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.638922 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:35.641795 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.641778 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:43:35.729111 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.729085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:35.830789 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:35.830744 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:36.203694 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.203649 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:36.204565 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.204539 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:36.389378 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.389277 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:43:35.641792343Z","UUID":"b7813f71-642b-45a4-b4b5-788b9999b881","Handler":null,"Name":"","Endpoint":""} Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.389670 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.389704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:36.389788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:36.389893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.389953 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:36.390119 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:36.390023 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:36.391191 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.391173 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:43:36.391298 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.391226 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:43:36.530337 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.530305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" event={"ID":"ca9211e0-f275-4dec-8e74-c2d6d16b4418","Type":"ContainerStarted","Data":"0f6340ad4ba12c9309ef5131f182e07326b49f7c926ef972a11dfe50fbe8fad2"} Jun 11 21:43:36.530778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.530367 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" event={"ID":"ca9211e0-f275-4dec-8e74-c2d6d16b4418","Type":"ContainerStarted","Data":"ebb053b020842779d3648d8deccdc02505da729ef87f19ab9268fc517540191e"} Jun 11 21:43:36.531961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.531930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxvzv" event={"ID":"c80a5a83-9eb4-47cf-b4a9-384710317179","Type":"ContainerStarted","Data":"cfedf239e67a7a3ba6f4aa8018ec46a6b98a5a253f4378cf96547d7a05f2e74c"} Jun 11 21:43:36.544769 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.544713 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jgx5l" podStartSLOduration=12.246817402 podStartE2EDuration="24.544695848s" totalImagesPullingTime="12.297878446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:36.544393373 +0000 UTC m=+24.612164509" watchObservedRunningTime="2026-06-11 21:43:36.544695848 +0000 UTC m=+24.612466982" Jun 11 21:43:36.557144 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.557108 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gxvzv" podStartSLOduration=5.602322186 podStartE2EDuration="24.557095337s" totalImagesPullingTime="18.954773151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:36.556736984 +0000 UTC m=+24.624508130" watchObservedRunningTime="2026-06-11 21:43:36.557095337 +0000 UTC m=+24.624866471" Jun 11 21:43:36.674385 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.674350 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:36.775283 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.775105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:36.824468 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:36.824434 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:37.537280 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:37.537256 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:43:37.537812 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:37.537797 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:43:37.537905 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:37.537837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"5f5dfb5844c508718981f210d7a6ba3a24b9254c454803241aa21b632dc96562"} Jun 11 21:43:38.316541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.316511 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:38.317072 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.317055 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k5th4" Jun 11 21:43:38.365577 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.365526 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:38.389616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.389589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:38.389616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.389605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:38.389616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:38.389606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:38.389879 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:38.389742 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:38.389918 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:38.389886 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:38.389978 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:38.389962 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:40.285079 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:40.285038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:40.385096 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:40.385062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:40.389866 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:40.389867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:40.389993 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:40.390084 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:40.390133 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:40.391500 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:40.390205 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:41.548494 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.548319 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="2d13d84a75bacec679c86c35ee2f36bf75c31f33b4b833c6dd60d2a58e3b8177" exitCode=0 Jun 11 21:43:41.549042 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.548402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"2d13d84a75bacec679c86c35ee2f36bf75c31f33b4b833c6dd60d2a58e3b8177"} Jun 11 21:43:41.552067 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.552048 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:43:41.552395 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.552375 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"9a81fd4a1f1215326a54b0c0d2f2fe0750526c2cfa618a94bdb17b435b6484c2"} Jun 11 21:43:41.552695 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.552673 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:41.552789 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.552747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:41.552842 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.552827 2581 scope.go:117] "RemoveContainer" containerID="e0981060a3af45f4340b3df493b20309bda5961dab5e167486341091fae20723" Jun 11 21:43:41.571616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:41.571577 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:42.391296 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.391265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:42.391457 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.391369 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:42.391457 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.391391 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:42.391457 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.391427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:42.391621 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.391494 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:42.391621 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.391569 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:42.557494 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.557467 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:43:42.557852 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.557803 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" event={"ID":"a8e6a01f-41c0-4655-8d69-a619baad3359","Type":"ContainerStarted","Data":"923928c4fd5fdbcc79033385bfad5e76e51acd50c8977bf72dc0123021bb69ec"} Jun 11 21:43:42.558083 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.558063 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:42.575983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.575834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:43:42.582067 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.582023 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" podStartSLOduration=11.530726881 podStartE2EDuration="30.582002464s" totalImagesPullingTime="19.051275583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:42.581620714 +0000 UTC m=+30.649391848" watchObservedRunningTime="2026-06-11 21:43:42.582002464 +0000 UTC m=+30.649773598" Jun 11 21:43:42.691922 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.691889 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65tgf"] Jun 11 21:43:42.692077 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.692051 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:42.692595 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.692152 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:42.694718 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.694697 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnq2q"] Jun 11 21:43:42.694835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.694811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:42.694938 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.694917 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:42.695454 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.695430 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zm4q"] Jun 11 21:43:42.695547 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:42.695525 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:42.695645 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:42.695626 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:43.562298 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:43.562269 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="6bf986cfc431c710447f89388f3dca4791a91e0f25651745ba124e357e57ac09" exitCode=0 Jun 11 21:43:43.562759 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:43.562337 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"6bf986cfc431c710447f89388f3dca4791a91e0f25651745ba124e357e57ac09"} Jun 11 21:43:44.389764 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:44.389731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:44.389764 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:44.389753 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:44.389993 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:44.389858 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:44.389993 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:44.389899 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:44.389993 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:44.389932 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:44.390139 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:44.390026 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:45.568873 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:45.568841 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="65f6be0ad22964ad2b204b57eca09bda2f4f94bacd3acd0a454b701b97837e1e" exitCode=0 Jun 11 21:43:45.569545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:45.568879 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"65f6be0ad22964ad2b204b57eca09bda2f4f94bacd3acd0a454b701b97837e1e"} Jun 11 21:43:46.085420 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.085387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:46.085618 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.085441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:46.085618 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.085472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:46.085618 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085575 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:46.085618 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085601 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:43:46.085618 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085617 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:43:46.085851 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085619 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:46.085851 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085629 2581 projected.go:196] Error preparing data for projected volume kube-api-access-n5sdm for pod openshift-network-diagnostics/network-check-target-pnq2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:46.085851 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085675 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:44:18.085636166 +0000 UTC m=+66.153407279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:43:46.085851 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085699 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm podName:990d700c-9bc6-47a0-bfd5-0fbd3be02845 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:18.085683524 +0000 UTC m=+66.153454654 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n5sdm" (UniqueName: "kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm") pod "network-check-target-pnq2q" (UID: "990d700c-9bc6-47a0-bfd5-0fbd3be02845") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:43:46.085851 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.085719 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret podName:8e5123d9-bf98-4743-9157-eca3ab0a2be4 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:18.085709698 +0000 UTC m=+66.153480816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret") pod "global-pull-secret-syncer-65tgf" (UID: "8e5123d9-bf98-4743-9157-eca3ab0a2be4") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:43:46.390045 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.389943 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:46.390216 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.389943 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:46.390216 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.390062 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:43:46.390216 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:46.390086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:46.390216 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.390178 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pnq2q" podUID="990d700c-9bc6-47a0-bfd5-0fbd3be02845" Jun 11 21:43:46.390395 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:46.390267 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65tgf" podUID="8e5123d9-bf98-4743-9157-eca3ab0a2be4" Jun 11 21:43:47.260910 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.260880 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-164.ec2.internal" event="NodeReady" Jun 11 21:43:47.261473 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.261035 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:43:47.302834 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.302802 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-94ddb"] Jun 11 21:43:47.321411 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.321379 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gpz6t"] Jun 11 21:43:47.321573 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.321513 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.323381 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.323147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:43:47.323381 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.323174 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td5zs\"" Jun 11 21:43:47.323381 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.323201 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:43:47.345311 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.345276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94ddb"] Jun 11 21:43:47.345311 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.345313 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpz6t"] Jun 11 21:43:47.345499 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.345409 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.347454 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.347098 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:43:47.347454 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.347214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:43:47.347454 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.347327 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:43:47.348106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.348081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qvtk\"" Jun 11 21:43:47.427839 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.427807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:47.476573 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.476535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:47.495490 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-config-volume\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.495704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-tmp-dir\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.495704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m2qg\" (UniqueName: \"kubernetes.io/projected/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-kube-api-access-8m2qg\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.495704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.495868 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9f259d-d75b-4318-bc9c-47a70786d29c-cert\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.495868 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.495783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6stlf\" (UniqueName: \"kubernetes.io/projected/3c9f259d-d75b-4318-bc9c-47a70786d29c-kube-api-access-6stlf\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.596781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-config-volume\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.596781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-tmp-dir\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.596781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596741 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m2qg\" (UniqueName: \"kubernetes.io/projected/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-kube-api-access-8m2qg\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.597106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.597106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9f259d-d75b-4318-bc9c-47a70786d29c-cert\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.597106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.596868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6stlf\" (UniqueName: \"kubernetes.io/projected/3c9f259d-d75b-4318-bc9c-47a70786d29c-kube-api-access-6stlf\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.597106 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:47.596963 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:47.597106 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:47.597056 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:48.097036125 +0000 UTC m=+36.164807238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:43:47.597398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.597116 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-tmp-dir\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.597398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.597303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-config-volume\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.601872 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.601849 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9f259d-d75b-4318-bc9c-47a70786d29c-cert\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.604538 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.604518 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6stlf\" (UniqueName: \"kubernetes.io/projected/3c9f259d-d75b-4318-bc9c-47a70786d29c-kube-api-access-6stlf\") pod \"ingress-canary-gpz6t\" (UID: \"3c9f259d-d75b-4318-bc9c-47a70786d29c\") " pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.604697 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.604676 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m2qg\" (UniqueName: \"kubernetes.io/projected/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-kube-api-access-8m2qg\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:47.656818 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.656784 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpz6t" Jun 11 21:43:47.873846 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:47.873567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpz6t"] Jun 11 21:43:47.878103 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:47.878072 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9f259d_d75b_4318_bc9c_47a70786d29c.slice/crio-84d650be5c4554df6e3cfeae717431690e109ec2fe2984aa8e0efd8647196165 WatchSource:0}: Error finding container 84d650be5c4554df6e3cfeae717431690e109ec2fe2984aa8e0efd8647196165: Status 404 returned error can't find the container with id 84d650be5c4554df6e3cfeae717431690e109ec2fe2984aa8e0efd8647196165 Jun 11 21:43:48.100422 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.100389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:48.100572 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:48.100515 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:48.100639 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:48.100575 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:49.100560704 +0000 UTC m=+37.168331821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:43:48.390393 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.390361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:43:48.390393 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.390398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:43:48.390900 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.390361 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:43:48.393466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393331 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:43:48.393466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrlsh\"" Jun 11 21:43:48.393466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393346 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvwg4\"" Jun 11 21:43:48.393466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:43:48.393466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393422 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:43:48.393838 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.393597 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:43:48.576728 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:48.576690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpz6t" event={"ID":"3c9f259d-d75b-4318-bc9c-47a70786d29c","Type":"ContainerStarted","Data":"84d650be5c4554df6e3cfeae717431690e109ec2fe2984aa8e0efd8647196165"} Jun 11 21:43:49.109456 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:49.109416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:49.109646 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:49.109553 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:49.109646 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:49.109615 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:51.109596653 +0000 UTC m=+39.177367774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:43:51.125603 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:51.125569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:51.126112 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:51.125755 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:51.126112 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:51.125815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:43:55.125800702 +0000 UTC m=+43.193571815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:43:52.589021 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.588821 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="021215baccfab54929c4cc0b9da2f49ddc3a86a114facc7281afed4139bcefcb" exitCode=0 Jun 11 21:43:52.589487 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.588906 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"021215baccfab54929c4cc0b9da2f49ddc3a86a114facc7281afed4139bcefcb"} Jun 11 21:43:52.590506 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.590486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpz6t" event={"ID":"3c9f259d-d75b-4318-bc9c-47a70786d29c","Type":"ContainerStarted","Data":"1599037406d0e5ee4909ec095c45dbd4854b142bcd2cb2a1c45c78c075f17d81"} Jun 11 21:43:52.624544 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.624488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gpz6t" podStartSLOduration=1.9594148580000001 podStartE2EDuration="5.624468467s" totalImagesPullingTime="3.665053609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:52.623181265 +0000 UTC m=+40.690952400" watchObservedRunningTime="2026-06-11 21:43:52.624468467 +0000 UTC m=+40.692239603" Jun 11 21:43:52.644983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.644951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:52.690721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:52.690691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:53.596342 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.596313 2581 generic.go:356] "Generic (PLEG): container finished" podID="e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7" containerID="04ac8800e2c7b40d27f47ad351225a4563b3a71317bffec2c32c4c2cbdeb112f" exitCode=0 Jun 11 21:43:53.598457 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.596376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerDied","Data":"04ac8800e2c7b40d27f47ad351225a4563b3a71317bffec2c32c4c2cbdeb112f"} Jun 11 21:43:53.831209 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.831173 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr"] Jun 11 21:43:53.834633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.833505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:53.835683 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.835637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 21:43:53.835683 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.835641 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 21:43:53.835904 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.835728 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 21:43:53.836052 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.836036 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 21:43:53.850725 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.850671 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr"] Jun 11 21:43:53.946535 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.946501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc9r8\" (UniqueName: \"kubernetes.io/projected/3f553d7a-7d9b-458c-b9da-67e19a1fa836-kube-api-access-gc9r8\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:53.946535 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.946550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f553d7a-7d9b-458c-b9da-67e19a1fa836-tmp\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:53.946762 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:53.946585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3f553d7a-7d9b-458c-b9da-67e19a1fa836-klusterlet-config\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.047423 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.047388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc9r8\" (UniqueName: \"kubernetes.io/projected/3f553d7a-7d9b-458c-b9da-67e19a1fa836-kube-api-access-gc9r8\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.047553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.047433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f553d7a-7d9b-458c-b9da-67e19a1fa836-tmp\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.047553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.047470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3f553d7a-7d9b-458c-b9da-67e19a1fa836-klusterlet-config\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.047904 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.047882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f553d7a-7d9b-458c-b9da-67e19a1fa836-tmp\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.051783 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.051755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3f553d7a-7d9b-458c-b9da-67e19a1fa836-klusterlet-config\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.054500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.054477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc9r8\" (UniqueName: \"kubernetes.io/projected/3f553d7a-7d9b-458c-b9da-67e19a1fa836-kube-api-access-gc9r8\") pod \"klusterlet-addon-workmgr-d6d5b454c-4wpxr\" (UID: \"3f553d7a-7d9b-458c-b9da-67e19a1fa836\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.142895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.142814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:54.261845 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.261812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr"] Jun 11 21:43:54.266590 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:43:54.266563 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f553d7a_7d9b_458c_b9da_67e19a1fa836.slice/crio-52188bb8cda2113030cdea7a3041adaf1a0ddd02107894b98ec2a377a77a8f86 WatchSource:0}: Error finding container 52188bb8cda2113030cdea7a3041adaf1a0ddd02107894b98ec2a377a77a8f86: Status 404 returned error can't find the container with id 52188bb8cda2113030cdea7a3041adaf1a0ddd02107894b98ec2a377a77a8f86 Jun 11 21:43:54.601779 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.601737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-btxbh" event={"ID":"e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7","Type":"ContainerStarted","Data":"f9b3ca5f2036847590157820ccb72b6f006f3996021f9968d5fd077ed28684e5"} Jun 11 21:43:54.602837 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.602818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" event={"ID":"3f553d7a-7d9b-458c-b9da-67e19a1fa836","Type":"ContainerStarted","Data":"52188bb8cda2113030cdea7a3041adaf1a0ddd02107894b98ec2a377a77a8f86"} Jun 11 21:43:54.620592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.620550 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-btxbh" podStartSLOduration=10.072661946 podStartE2EDuration="42.620535943s" totalImagesPullingTime="32.547873997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:54.619452413 +0000 UTC m=+42.687223559" watchObservedRunningTime="2026-06-11 21:43:54.620535943 +0000 UTC m=+42.688307076" Jun 11 21:43:54.741262 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.741227 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:54.796039 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:54.796003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:55.157188 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:55.157145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:43:55.157381 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:55.157317 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:43:55.157442 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:43:55.157381 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:03.157365265 +0000 UTC m=+51.225136377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:43:58.257090 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.257054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:58.356614 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.356583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:43:58.614055 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.613966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" event={"ID":"3f553d7a-7d9b-458c-b9da-67e19a1fa836","Type":"ContainerStarted","Data":"d6e4519dfb7d581777cd1b24346ab1266e1e91b4ad9846f480468e63ed0a53ad"} Jun 11 21:43:58.614198 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.614183 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:58.615785 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.615764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:43:58.627982 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:43:58.627941 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" podStartSLOduration=2.059202742 podStartE2EDuration="5.627926785s" totalImagesPullingTime="3.568724043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:43:58.626855036 +0000 UTC m=+46.694626185" watchObservedRunningTime="2026-06-11 21:43:58.627926785 +0000 UTC m=+46.695697919" Jun 11 21:44:03.219455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:03.219419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:44:03.219943 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:03.219536 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:44:03.219943 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:03.219586 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:19.219572242 +0000 UTC m=+67.287343355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:44:14.574742 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:14.574710 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk4q7" Jun 11 21:44:14.697296 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:14.697257 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:14.797583 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:14.797551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:14.853324 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:14.853253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:18.121431 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.121364 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:44:18.121431 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.121442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:44:18.121900 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.121492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:44:18.123173 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.123152 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:44:18.123292 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.123238 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:44:18.123352 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.123318 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:44:18.132582 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:18.132563 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:44:18.132646 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:18.132626 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:45:22.132604569 +0000 UTC m=+130.200375683 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : secret "metrics-daemon-secret" not found Jun 11 21:44:18.133779 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.133754 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:44:18.134923 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.134903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e5123d9-bf98-4743-9157-eca3ab0a2be4-original-pull-secret\") pod \"global-pull-secret-syncer-65tgf\" (UID: \"8e5123d9-bf98-4743-9157-eca3ab0a2be4\") " pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:44:18.145145 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.145124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5sdm\" (UniqueName: \"kubernetes.io/projected/990d700c-9bc6-47a0-bfd5-0fbd3be02845-kube-api-access-n5sdm\") pod \"network-check-target-pnq2q\" (UID: \"990d700c-9bc6-47a0-bfd5-0fbd3be02845\") " pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:44:18.415029 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.414954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tvwg4\"" Jun 11 21:44:18.418323 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.418308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65tgf" Jun 11 21:44:18.423154 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.423133 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:44:18.552222 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.552188 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pnq2q"] Jun 11 21:44:18.555414 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:44:18.555388 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990d700c_9bc6_47a0_bfd5_0fbd3be02845.slice/crio-347560d758a65653a42307ecb266f3158c71d7fae935b668be013025fc298a21 WatchSource:0}: Error finding container 347560d758a65653a42307ecb266f3158c71d7fae935b668be013025fc298a21: Status 404 returned error can't find the container with id 347560d758a65653a42307ecb266f3158c71d7fae935b668be013025fc298a21 Jun 11 21:44:18.566468 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.566439 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65tgf"] Jun 11 21:44:18.570507 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:44:18.570483 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5123d9_bf98_4743_9157_eca3ab0a2be4.slice/crio-26c0c793fc65b4668686130b4d531c28bbf6162fa8a9382833c290ed7d458e2b WatchSource:0}: Error finding container 26c0c793fc65b4668686130b4d531c28bbf6162fa8a9382833c290ed7d458e2b: Status 404 returned error can't find the container with id 26c0c793fc65b4668686130b4d531c28bbf6162fa8a9382833c290ed7d458e2b Jun 11 21:44:18.665398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.665294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-65tgf" event={"ID":"8e5123d9-bf98-4743-9157-eca3ab0a2be4","Type":"ContainerStarted","Data":"26c0c793fc65b4668686130b4d531c28bbf6162fa8a9382833c290ed7d458e2b"} Jun 11 21:44:18.666315 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:18.666291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnq2q" event={"ID":"990d700c-9bc6-47a0-bfd5-0fbd3be02845","Type":"ContainerStarted","Data":"347560d758a65653a42307ecb266f3158c71d7fae935b668be013025fc298a21"} Jun 11 21:44:19.228888 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:19.228847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:44:19.229289 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:19.229076 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:44:19.229289 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:19.229160 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:44:51.229139637 +0000 UTC m=+99.296910757 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:44:24.682726 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:24.682689 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-65tgf" event={"ID":"8e5123d9-bf98-4743-9157-eca3ab0a2be4","Type":"ContainerStarted","Data":"7e70584f8c2e55eccc38a848311f5705c6a84b290cca9cd904e4b3b2fafc4d5e"} Jun 11 21:44:24.684105 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:24.684081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pnq2q" event={"ID":"990d700c-9bc6-47a0-bfd5-0fbd3be02845","Type":"ContainerStarted","Data":"595e286633ce1be0ae46ca6b33c6981d43accd7c083ba8ad690feb00b2b93943"} Jun 11 21:44:24.684221 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:24.684204 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:44:24.694927 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:24.694882 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-65tgf" podStartSLOduration=67.404906713 podStartE2EDuration="1m12.694865083s" totalImagesPullingTime="5.28995837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:44:24.694361692 +0000 UTC m=+72.762132826" watchObservedRunningTime="2026-06-11 21:44:24.694865083 +0000 UTC m=+72.762636215" Jun 11 21:44:24.706765 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:24.706713 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pnq2q" podStartSLOduration=67.404578351 podStartE2EDuration="1m12.706695218s" totalImagesPullingTime="5.302116867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:44:24.705951288 +0000 UTC m=+72.773722448" watchObservedRunningTime="2026-06-11 21:44:24.706695218 +0000 UTC m=+72.774466356" Jun 11 21:44:47.536208 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:47.536173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:44:51.249645 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:51.249595 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:44:51.250056 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:51.249769 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:44:51.250056 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:44:51.249850 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:45:55.24983456 +0000 UTC m=+163.317605674 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:44:55.689008 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:44:55.688973 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pnq2q" Jun 11 21:45:22.155133 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:22.155087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:45:22.155508 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:22.155239 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:45:22.155508 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:22.155318 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs podName:889db87a-4683-4dc3-9f77-6f624179cfcd nodeName:}" failed. No retries permitted until 2026-06-11 21:47:24.155299724 +0000 UTC m=+252.223070840 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs") pod "network-metrics-daemon-4zm4q" (UID: "889db87a-4683-4dc3-9f77-6f624179cfcd") : secret "metrics-daemon-secret" not found Jun 11 21:45:45.343957 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:45.343920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:45:50.332880 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:50.332830 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-94ddb" podUID="7689cdfb-5638-4ca9-99dd-4a379f1b4a69" Jun 11 21:45:50.893430 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:50.893403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94ddb" Jun 11 21:45:51.404478 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:51.404426 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4zm4q" podUID="889db87a-4683-4dc3-9f77-6f624179cfcd" Jun 11 21:45:55.275290 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:55.275247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:45:55.275699 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:55.275357 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:45:55.275699 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:45:55.275420 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls podName:7689cdfb-5638-4ca9-99dd-4a379f1b4a69 nodeName:}" failed. No retries permitted until 2026-06-11 21:47:57.275405193 +0000 UTC m=+285.343176307 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls") pod "dns-default-94ddb" (UID: "7689cdfb-5638-4ca9-99dd-4a379f1b4a69") : secret "dns-default-metrics-tls" not found Jun 11 21:45:58.615500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:58.615455 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" podUID="3f553d7a-7d9b-458c-b9da-67e19a1fa836" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 11 21:45:58.912948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:58.912868 2581 generic.go:356] "Generic (PLEG): container finished" podID="3f553d7a-7d9b-458c-b9da-67e19a1fa836" containerID="d6e4519dfb7d581777cd1b24346ab1266e1e91b4ad9846f480468e63ed0a53ad" exitCode=1 Jun 11 21:45:58.912948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:58.912924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" event={"ID":"3f553d7a-7d9b-458c-b9da-67e19a1fa836","Type":"ContainerDied","Data":"d6e4519dfb7d581777cd1b24346ab1266e1e91b4ad9846f480468e63ed0a53ad"} Jun 11 21:45:58.913236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:58.913225 2581 scope.go:117] "RemoveContainer" containerID="d6e4519dfb7d581777cd1b24346ab1266e1e91b4ad9846f480468e63ed0a53ad" Jun 11 21:45:59.918147 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:59.918094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" event={"ID":"3f553d7a-7d9b-458c-b9da-67e19a1fa836","Type":"ContainerStarted","Data":"6759fcdf59cbc538e6148979615775451c1cd95bcf226402137bbd5a032f583d"} Jun 11 21:45:59.918710 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:59.918418 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:45:59.919044 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:45:59.919016 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d6d5b454c-4wpxr" Jun 11 21:46:03.389704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:03.389642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:46:10.364145 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.364112 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-pc5lv"] Jun 11 21:46:10.365927 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.365911 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww"] Jun 11 21:46:10.366048 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.366030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.367570 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.367545 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-wlz8d"] Jun 11 21:46:10.367717 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.367698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.369781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.369761 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.370451 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370428 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 21:46:10.370681 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370650 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-md8ws\"" Jun 11 21:46:10.370795 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.370795 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 21:46:10.370954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370801 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 21:46:10.370954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370914 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.370954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.370925 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 21:46:10.371778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.371737 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:46:10.374106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.373973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.376040 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.376013 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 21:46:10.376602 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.376578 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.376756 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.376739 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rm5bw\"" Jun 11 21:46:10.376956 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.376937 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 21:46:10.377314 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.377286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.377788 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.377769 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sdrjl\"" Jun 11 21:46:10.378168 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.378144 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 21:46:10.378429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.378397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2qw2b\"" Jun 11 21:46:10.379057 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.379041 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 21:46:10.380019 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.380001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 21:46:10.381285 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.381265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-pc5lv"] Jun 11 21:46:10.382070 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.382053 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 21:46:10.384566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.384542 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-wlz8d"] Jun 11 21:46:10.385178 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.385155 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 21:46:10.385256 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.385226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww"] Jun 11 21:46:10.387371 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.387352 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:46:10.462847 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.462818 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-798967cdf8-qklkj"] Jun 11 21:46:10.464734 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.464719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.466531 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.466511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 21:46:10.466618 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.466596 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 21:46:10.466708 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.466687 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 21:46:10.466769 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.466755 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:46:10.466901 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.466885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cjpxz\"" Jun 11 21:46:10.467101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.467089 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 21:46:10.467188 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.467171 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:46:10.479238 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.479218 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-798967cdf8-qklkj"] Jun 11 21:46:10.480457 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ff4j\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480640 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.480640 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlrmf\" (UniqueName: \"kubernetes.io/projected/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-kube-api-access-hlrmf\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.480640 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480796 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8lml\" (UniqueName: \"kubernetes.io/projected/03928bf9-3655-4af2-b415-05d3351ecb09-kube-api-access-w8lml\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.480796 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-snapshots\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.480796 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480796 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c11c31e7-b296-497a-acbf-efdbf6e33fc9-nginx-conf\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.480931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.480931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-config\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.480931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-tmp\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.480995 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.481011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.481033 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.481026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03928bf9-3655-4af2-b415-05d3351ecb09-serving-cert\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-tmp\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582346 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582134 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582346 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03928bf9-3655-4af2-b415-05d3351ecb09-serving-cert\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582346 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582346 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ff4j\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-stats-auth\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlrmf\" (UniqueName: \"kubernetes.io/projected/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-kube-api-access-hlrmf\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8lml\" (UniqueName: \"kubernetes.io/projected/03928bf9-3655-4af2-b415-05d3351ecb09-kube-api-access-w8lml\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582527 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-tmp\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-snapshots\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx8bg\" (UniqueName: \"kubernetes.io/projected/555624e4-380d-4b49-ae5b-ae20e7038c64-kube-api-access-kx8bg\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c11c31e7-b296-497a-acbf-efdbf6e33fc9-nginx-conf\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.582871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.582977 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.582939 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:10.583342 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.583022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.083003224 +0000 UTC m=+179.150774343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:10.583342 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583240 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-config\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.583342 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.583503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-default-certificate\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.583503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.583503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.583503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.583735 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.583828 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.583805 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-config\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.583922 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.583907 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:46:10.583982 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.583925 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df7d978fd-gznk8: secret "image-registry-tls" not found Jun 11 21:46:10.584035 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.584005 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls podName:2d66fbe2-e86b-4c30-bd9d-63461f766382 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.083985335 +0000 UTC m=+179.151756463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls") pod "image-registry-5df7d978fd-gznk8" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382") : secret "image-registry-tls" not found Jun 11 21:46:10.584149 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.584127 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c11c31e7-b296-497a-acbf-efdbf6e33fc9-nginx-conf\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:10.584446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.584410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03928bf9-3655-4af2-b415-05d3351ecb09-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.584702 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.584561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.584702 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.584649 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03928bf9-3655-4af2-b415-05d3351ecb09-snapshots\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.585214 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.585191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03928bf9-3655-4af2-b415-05d3351ecb09-serving-cert\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.585303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.585237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.585966 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.585945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.586089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.586073 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.600730 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.600711 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlrmf\" (UniqueName: \"kubernetes.io/projected/9be3abdd-3c50-4c8f-b082-25260bcd9e1d-kube-api-access-hlrmf\") pod \"service-ca-operator-7ccbfd59dc-9dbww\" (UID: \"9be3abdd-3c50-4c8f-b082-25260bcd9e1d\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.600940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.600922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8lml\" (UniqueName: \"kubernetes.io/projected/03928bf9-3655-4af2-b415-05d3351ecb09-kube-api-access-w8lml\") pod \"insights-operator-5bbd86d6bd-wlz8d\" (UID: \"03928bf9-3655-4af2-b415-05d3351ecb09\") " pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.601022 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.601002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.601135 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.601120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ff4j\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:10.631685 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.631600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:10.683807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.683765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.683807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.683810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-stats-auth\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.684006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.683849 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx8bg\" (UniqueName: \"kubernetes.io/projected/555624e4-380d-4b49-ae5b-ae20e7038c64-kube-api-access-kx8bg\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.684006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.683872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.684006 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.683936 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.183919544 +0000 UTC m=+179.251690656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : configmap references non-existent config key: service-ca.crt Jun 11 21:46:10.684006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.683975 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-default-certificate\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.684006 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.683991 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:46:10.684194 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:10.684048 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:11.184032153 +0000 UTC m=+179.251803283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : secret "router-metrics-certs-default" not found Jun 11 21:46:10.686522 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.686495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-default-certificate\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.686621 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.686542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-stats-auth\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.687442 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.687419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:10.688469 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.688453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" Jun 11 21:46:10.690980 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.690959 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx8bg\" (UniqueName: \"kubernetes.io/projected/555624e4-380d-4b49-ae5b-ae20e7038c64-kube-api-access-kx8bg\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:10.695389 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.695364 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" Jun 11 21:46:10.821776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.821742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww"] Jun 11 21:46:10.825556 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:10.825521 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be3abdd_3c50_4c8f_b082_25260bcd9e1d.slice/crio-7ea63a96dc7c1d10ec52fc2e81a633e3a0a0becce4f5a8830a6c35ffe7d781df WatchSource:0}: Error finding container 7ea63a96dc7c1d10ec52fc2e81a633e3a0a0becce4f5a8830a6c35ffe7d781df: Status 404 returned error can't find the container with id 7ea63a96dc7c1d10ec52fc2e81a633e3a0a0becce4f5a8830a6c35ffe7d781df Jun 11 21:46:10.838344 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.838317 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-wlz8d"] Jun 11 21:46:10.841730 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:10.841705 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03928bf9_3655_4af2_b415_05d3351ecb09.slice/crio-7ac6bb3bfaa0a59ad1b5fc4daae852cd0931ea3ba2f51e05a7311ac3218e3ef0 WatchSource:0}: Error finding container 7ac6bb3bfaa0a59ad1b5fc4daae852cd0931ea3ba2f51e05a7311ac3218e3ef0: Status 404 returned error can't find the container with id 7ac6bb3bfaa0a59ad1b5fc4daae852cd0931ea3ba2f51e05a7311ac3218e3ef0 Jun 11 21:46:10.949509 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.949410 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" event={"ID":"03928bf9-3655-4af2-b415-05d3351ecb09","Type":"ContainerStarted","Data":"7ac6bb3bfaa0a59ad1b5fc4daae852cd0931ea3ba2f51e05a7311ac3218e3ef0"} Jun 11 21:46:10.950406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:10.950381 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" event={"ID":"9be3abdd-3c50-4c8f-b082-25260bcd9e1d","Type":"ContainerStarted","Data":"7ea63a96dc7c1d10ec52fc2e81a633e3a0a0becce4f5a8830a6c35ffe7d781df"} Jun 11 21:46:11.091995 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:11.091955 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:11.092168 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:11.092020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:11.092168 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.092105 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:11.092168 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.092130 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:46:11.092168 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.092152 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df7d978fd-gznk8: secret "image-registry-tls" not found Jun 11 21:46:11.092168 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.092168 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.092153653 +0000 UTC m=+180.159924766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:11.092341 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.092206 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls podName:2d66fbe2-e86b-4c30-bd9d-63461f766382 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.092193536 +0000 UTC m=+180.159964652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls") pod "image-registry-5df7d978fd-gznk8" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382") : secret "image-registry-tls" not found Jun 11 21:46:11.192931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:11.192900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:11.193086 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:11.192981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:11.193123 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.193075 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:46:11.193157 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.193083 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.193068764 +0000 UTC m=+180.260839876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : configmap references non-existent config key: service-ca.crt Jun 11 21:46:11.193157 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:11.193153 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:12.193134779 +0000 UTC m=+180.260905892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : secret "router-metrics-certs-default" not found Jun 11 21:46:12.102405 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.102365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.102467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.102560 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.102586 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df7d978fd-gznk8: secret "image-registry-tls" not found Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.102606 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.102643 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls podName:2d66fbe2-e86b-4c30-bd9d-63461f766382 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.102628937 +0000 UTC m=+182.170400083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls") pod "image-registry-5df7d978fd-gznk8" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382") : secret "image-registry-tls" not found Jun 11 21:46:12.102901 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.102683 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.10264916 +0000 UTC m=+182.170420278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:12.203067 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.203030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:12.203228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.203090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:12.203228 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.203198 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:46:12.203358 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.203235 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.203213531 +0000 UTC m=+182.270984664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : configmap references non-existent config key: service-ca.crt Jun 11 21:46:12.203358 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:12.203265 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:14.203254391 +0000 UTC m=+182.271025505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : secret "router-metrics-certs-default" not found Jun 11 21:46:12.785802 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.785765 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:12.887330 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:12.887291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:13.964085 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:13.963997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" event={"ID":"9be3abdd-3c50-4c8f-b082-25260bcd9e1d","Type":"ContainerStarted","Data":"c04fa34a147a57355e12eda8dc6b6827b993c8a2bec8d0623c830b1bbccee94a"} Jun 11 21:46:13.965524 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:13.965498 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" event={"ID":"03928bf9-3655-4af2-b415-05d3351ecb09","Type":"ContainerStarted","Data":"af13f5725b29a8a0ec6bcc6d94eb899381be4d399eeb5f0a4c760470d38cc2cb"} Jun 11 21:46:13.977378 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:13.977326 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" podStartSLOduration=1.2873156190000001 podStartE2EDuration="3.977309434s" totalImagesPullingTime="2.689993815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:13.976772465 +0000 UTC m=+182.044543597" watchObservedRunningTime="2026-06-11 21:46:13.977309434 +0000 UTC m=+182.045080571" Jun 11 21:46:13.989949 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:13.989901 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" podStartSLOduration=1.317589242 podStartE2EDuration="3.989882721s" totalImagesPullingTime="2.672293479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:13.989094344 +0000 UTC m=+182.056865479" watchObservedRunningTime="2026-06-11 21:46:13.989882721 +0000 UTC m=+182.057653860" Jun 11 21:46:14.121469 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.121426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:14.121684 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.121541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:14.121684 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.121581 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:14.121684 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.121650 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.121634831 +0000 UTC m=+186.189405950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:14.121841 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.121694 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:46:14.121841 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.121708 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df7d978fd-gznk8: secret "image-registry-tls" not found Jun 11 21:46:14.121841 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.121762 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls podName:2d66fbe2-e86b-4c30-bd9d-63461f766382 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.12174621 +0000 UTC m=+186.189517342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls") pod "image-registry-5df7d978fd-gznk8" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382") : secret "image-registry-tls" not found Jun 11 21:46:14.222032 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.221924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:14.222032 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.221988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:14.222243 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.222127 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.222098148 +0000 UTC m=+186.289869267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : configmap references non-existent config key: service-ca.crt Jun 11 21:46:14.222243 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.222167 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:46:14.222243 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:14.222234 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.222221072 +0000 UTC m=+186.289992185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : secret "router-metrics-certs-default" not found Jun 11 21:46:14.646192 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.646158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:14.741708 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.741672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:14.843267 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:14.843230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.045098 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.045068 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gnn22"] Jun 11 21:46:15.047757 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.047733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.049844 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.049821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gx8d\"" Jun 11 21:46:15.049960 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.049912 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:46:15.050238 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.050222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:46:15.056959 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.056939 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnn22"] Jun 11 21:46:15.073587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.073557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.128505 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.128473 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.129924 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.129900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwxkq\" (UniqueName: \"kubernetes.io/projected/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-api-access-nwxkq\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.130051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.129935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.130051 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.130008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b62ea8-02f6-4334-aa25-10e13049b27f-data-volume\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.130182 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.130087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b62ea8-02f6-4334-aa25-10e13049b27f-crio-socket\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.130182 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.130151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230559 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b62ea8-02f6-4334-aa25-10e13049b27f-crio-socket\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230747 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230747 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230676 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10b62ea8-02f6-4334-aa25-10e13049b27f-crio-socket\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230747 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.230696 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.230747 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwxkq\" (UniqueName: \"kubernetes.io/projected/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-api-access-nwxkq\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230995 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.230753 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:15.730740088 +0000 UTC m=+183.798511206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.230995 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230995 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.230803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b62ea8-02f6-4334-aa25-10e13049b27f-data-volume\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.230995 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.230858 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:15.230995 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.230911 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:15.730896677 +0000 UTC m=+183.798667791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : configmap "kube-rbac-proxy" not found Jun 11 21:46:15.231167 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.231126 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10b62ea8-02f6-4334-aa25-10e13049b27f-data-volume\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.240047 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.240028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwxkq\" (UniqueName: \"kubernetes.io/projected/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-api-access-nwxkq\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.329821 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.329726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.735812 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.735731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.736012 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.735842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:15.736012 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.735897 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:15.736012 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.735969 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.736012 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.735985 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:16.735962414 +0000 UTC m=+184.803733540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : configmap "kube-rbac-proxy" not found Jun 11 21:46:15.736012 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:15.736007 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:16.735996932 +0000 UTC m=+184.803768046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:15.740056 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.740034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:15.839429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:15.839397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:16.744428 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:16.744391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:16.745072 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:16.744443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:16.745072 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:16.744512 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:16.745072 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:16.744552 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:16.745072 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:16.744558 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.7445452 +0000 UTC m=+186.812316313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : configmap "kube-rbac-proxy" not found Jun 11 21:46:16.745072 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:16.744729 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:18.744699738 +0000 UTC m=+186.812470861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:16.812687 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:16.812643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:16.913050 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:16.913020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:17.340675 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.340626 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-4bjrx"] Jun 11 21:46:17.343407 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.343389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.345152 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.345130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 21:46:17.345276 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.345255 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qjb99\"" Jun 11 21:46:17.345344 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.345290 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 21:46:17.345524 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.345500 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 21:46:17.345604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.345581 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 21:46:17.352488 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.352467 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-4bjrx"] Jun 11 21:46:17.374733 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.374711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:17.425382 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.425345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:17.449409 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.449381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af038310-2502-4e52-92fc-29a22546d1d8-signing-cabundle\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.449522 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.449411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6s9n\" (UniqueName: \"kubernetes.io/projected/af038310-2502-4e52-92fc-29a22546d1d8-kube-api-access-s6s9n\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.449522 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.449432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af038310-2502-4e52-92fc-29a22546d1d8-signing-key\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.550423 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.550381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af038310-2502-4e52-92fc-29a22546d1d8-signing-cabundle\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.550581 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.550441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6s9n\" (UniqueName: \"kubernetes.io/projected/af038310-2502-4e52-92fc-29a22546d1d8-kube-api-access-s6s9n\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.550581 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.550463 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af038310-2502-4e52-92fc-29a22546d1d8-signing-key\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.550973 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.550954 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af038310-2502-4e52-92fc-29a22546d1d8-signing-cabundle\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.552908 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.552887 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af038310-2502-4e52-92fc-29a22546d1d8-signing-key\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.558336 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.558303 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6s9n\" (UniqueName: \"kubernetes.io/projected/af038310-2502-4e52-92fc-29a22546d1d8-kube-api-access-s6s9n\") pod \"service-ca-7b994bc59-4bjrx\" (UID: \"af038310-2502-4e52-92fc-29a22546d1d8\") " pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.627274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.627203 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l9zrf_386b7758-2d4f-4e98-bc8a-688929d3e998/dns-node-resolver/0.log" Jun 11 21:46:17.652099 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.652069 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" Jun 11 21:46:17.773500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.773470 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-4bjrx"] Jun 11 21:46:17.778838 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:17.778809 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf038310_2502_4e52_92fc_29a22546d1d8.slice/crio-c6132c3e3b275e9adef39021bc404f4580e94cfcdc4e4e820a821aa7638910f0 WatchSource:0}: Error finding container c6132c3e3b275e9adef39021bc404f4580e94cfcdc4e4e820a821aa7638910f0: Status 404 returned error can't find the container with id c6132c3e3b275e9adef39021bc404f4580e94cfcdc4e4e820a821aa7638910f0 Jun 11 21:46:17.979857 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.979768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" event={"ID":"af038310-2502-4e52-92fc-29a22546d1d8","Type":"ContainerStarted","Data":"3e702fad464acdadb1049fd32f6014a3c75b1641fdb2288264e74ac9ee5a9235"} Jun 11 21:46:17.979857 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:17.979820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" event={"ID":"af038310-2502-4e52-92fc-29a22546d1d8","Type":"ContainerStarted","Data":"c6132c3e3b275e9adef39021bc404f4580e94cfcdc4e4e820a821aa7638910f0"} Jun 11 21:46:18.000892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.000852 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-4bjrx" podStartSLOduration=1.000839114 podStartE2EDuration="1.000839114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:18.000140638 +0000 UTC m=+186.067911798" watchObservedRunningTime="2026-06-11 21:46:18.000839114 +0000 UTC m=+186.068610249" Jun 11 21:46:18.156544 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.156510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:18.156752 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.156597 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:18.156752 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.156690 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:18.156838 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.156752 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:46:18.156838 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.156764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.156747573 +0000 UTC m=+194.224518689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:18.156838 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.156765 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5df7d978fd-gznk8: secret "image-registry-tls" not found Jun 11 21:46:18.156838 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.156807 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls podName:2d66fbe2-e86b-4c30-bd9d-63461f766382 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.156796331 +0000 UTC m=+194.224567445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls") pod "image-registry-5df7d978fd-gznk8" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382") : secret "image-registry-tls" not found Jun 11 21:46:18.257378 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.257348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:18.257564 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.257409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:18.257564 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.257506 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:46:18.257703 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.257568 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.25755033 +0000 UTC m=+194.325321449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : secret "router-metrics-certs-default" not found Jun 11 21:46:18.257703 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.257629 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle podName:555624e4-380d-4b49-ae5b-ae20e7038c64 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:26.257618223 +0000 UTC m=+194.325389340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle") pod "router-default-798967cdf8-qklkj" (UID: "555624e4-380d-4b49-ae5b-ae20e7038c64") : configmap references non-existent config key: service-ca.crt Jun 11 21:46:18.282169 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.282139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:18.628225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.628154 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b6d6_da4b4611-50bd-48e4-91e7-3d724f3159d4/node-ca/0.log" Jun 11 21:46:18.714100 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.714062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:18.761921 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.761893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:18.762086 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.762032 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:18.762304 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.762184 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:18.762304 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.762213 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:18.762304 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.762249 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:22.762230191 +0000 UTC m=+190.830001306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:18.762304 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:18.762266 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:22.762255287 +0000 UTC m=+190.830026423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : configmap "kube-rbac-proxy" not found Jun 11 21:46:18.934105 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:18.934000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.057433 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.057393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.163883 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.163839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.259410 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.259368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.308354 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.308320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.401490 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.401457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:19.427641 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.427615 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpz6t_3c9f259d-d75b-4318-bc9c-47a70786d29c/serve-healthcheck-canary/0.log" Jun 11 21:46:19.801682 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:19.801636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:20.401757 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:20.401721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:20.797602 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:20.797566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:21.161720 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:21.161619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:21.411156 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:21.411122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:21.802510 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:21.802473 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:22.201843 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.201748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:22.396120 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.396070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:22.596930 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.596897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:22.796027 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.795993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:22.796218 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.796043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:22.796218 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:22.796134 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:46:22.796218 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:22.796170 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:46:22.796218 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:22.796183 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:30.79616919 +0000 UTC m=+198.863940304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : configmap "kube-rbac-proxy" not found Jun 11 21:46:22.796377 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:22.796230 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls podName:10b62ea8-02f6-4334-aa25-10e13049b27f nodeName:}" failed. No retries permitted until 2026-06-11 21:46:30.796213505 +0000 UTC m=+198.863984640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnn22" (UID: "10b62ea8-02f6-4334-aa25-10e13049b27f") : secret "insights-runtime-extractor-tls" not found Jun 11 21:46:22.832733 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:22.832691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:23.001543 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:23.001495 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:23.395245 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:23.395163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:23.807153 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:23.807120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:23.997793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:23.997759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:24.434218 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:24.434179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:24.598476 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:24.598438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:24.798958 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:24.798921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:25.125879 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:25.125787 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:25.225892 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:25.225865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:25.798761 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:25.798730 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:26.210274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.210185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:26.227219 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.227194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:26.227308 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.227274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:26.227432 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:26.227415 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 21:46:26.227501 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:26.227491 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert podName:c11c31e7-b296-497a-acbf-efdbf6e33fc9 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:42.227474892 +0000 UTC m=+210.295246028 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-pc5lv" (UID: "c11c31e7-b296-497a-acbf-efdbf6e33fc9") : secret "networking-console-plugin-cert" not found Jun 11 21:46:26.229804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.229786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"image-registry-5df7d978fd-gznk8\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:26.302579 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.302547 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2qw2b\"" Jun 11 21:46:26.311954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.311930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:26.328047 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.328018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:26.328194 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.328176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:26.328807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.328740 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/555624e4-380d-4b49-ae5b-ae20e7038c64-service-ca-bundle\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:26.330461 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.330441 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/555624e4-380d-4b49-ae5b-ae20e7038c64-metrics-certs\") pod \"router-default-798967cdf8-qklkj\" (UID: \"555624e4-380d-4b49-ae5b-ae20e7038c64\") " pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:26.375326 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.375220 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cjpxz\"" Jun 11 21:46:26.383950 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.383925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:26.446773 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.446747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:46:26.449224 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:26.449204 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d66fbe2_e86b_4c30_bd9d_63461f766382.slice/crio-96da70ac7d1464ae173891a6a039662b6bd49d1396bba3c8714727f08d4e47c5 WatchSource:0}: Error finding container 96da70ac7d1464ae173891a6a039662b6bd49d1396bba3c8714727f08d4e47c5: Status 404 returned error can't find the container with id 96da70ac7d1464ae173891a6a039662b6bd49d1396bba3c8714727f08d4e47c5 Jun 11 21:46:26.522446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.522414 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-798967cdf8-qklkj"] Jun 11 21:46:26.526522 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:26.526483 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555624e4_380d_4b49_ae5b_ae20e7038c64.slice/crio-2c3332853b0db9ca0821fe5074c03c8c33cb55ed9780ed0220fe5367bb68d8eb WatchSource:0}: Error finding container 2c3332853b0db9ca0821fe5074c03c8c33cb55ed9780ed0220fe5367bb68d8eb: Status 404 returned error can't find the container with id 2c3332853b0db9ca0821fe5074c03c8c33cb55ed9780ed0220fe5367bb68d8eb Jun 11 21:46:26.599046 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:26.599005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:27.000140 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.000105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:27.013968 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.013931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" event={"ID":"2d66fbe2-e86b-4c30-bd9d-63461f766382","Type":"ContainerStarted","Data":"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275"} Jun 11 21:46:27.014122 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.013984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" event={"ID":"2d66fbe2-e86b-4c30-bd9d-63461f766382","Type":"ContainerStarted","Data":"96da70ac7d1464ae173891a6a039662b6bd49d1396bba3c8714727f08d4e47c5"} Jun 11 21:46:27.014122 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.014009 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:46:27.015465 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.015441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-798967cdf8-qklkj" event={"ID":"555624e4-380d-4b49-ae5b-ae20e7038c64","Type":"ContainerStarted","Data":"c63bb7deb933cbef1f2ae31d5dfe7ee30836326741c86cc994b8babd1f3ee809"} Jun 11 21:46:27.015557 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.015486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-798967cdf8-qklkj" event={"ID":"555624e4-380d-4b49-ae5b-ae20e7038c64","Type":"ContainerStarted","Data":"2c3332853b0db9ca0821fe5074c03c8c33cb55ed9780ed0220fe5367bb68d8eb"} Jun 11 21:46:27.030338 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.030288 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" podStartSLOduration=17.030269649 podStartE2EDuration="17.030269649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:27.029290868 +0000 UTC m=+195.097061997" watchObservedRunningTime="2026-06-11 21:46:27.030269649 +0000 UTC m=+195.098040787" Jun 11 21:46:27.044940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.044860 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-798967cdf8-qklkj" podStartSLOduration=17.044850314 podStartE2EDuration="17.044850314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:27.044635661 +0000 UTC m=+195.112406808" watchObservedRunningTime="2026-06-11 21:46:27.044850314 +0000 UTC m=+195.112621443" Jun 11 21:46:27.385227 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.385138 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:27.387801 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.387774 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:27.405648 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.405615 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:27.598621 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.598582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:27.753209 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:27.753180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:28.000437 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:28.000407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:28.018882 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:28.018804 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:28.019981 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:28.019961 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-798967cdf8-qklkj" Jun 11 21:46:28.399140 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:28.399040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:28.907066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:28.907038 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:29.005514 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:29.005485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:29.105487 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:29.105456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:29.205727 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:29.205622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:29.396375 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:29.396344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:29.802645 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:29.802614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:30.867682 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:30.867625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:30.868069 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:30.867698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:30.868259 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:30.868239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10b62ea8-02f6-4334-aa25-10e13049b27f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:30.870016 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:30.869995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10b62ea8-02f6-4334-aa25-10e13049b27f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnn22\" (UID: \"10b62ea8-02f6-4334-aa25-10e13049b27f\") " pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:30.957202 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:30.957163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnn22" Jun 11 21:46:31.084102 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:31.084072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnn22"] Jun 11 21:46:31.087427 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:31.087400 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b62ea8_02f6_4334_aa25_10e13049b27f.slice/crio-d636a762a5c970261068cfaae64a72cfb5032f5a4dba5440268a11ee4939c348 WatchSource:0}: Error finding container d636a762a5c970261068cfaae64a72cfb5032f5a4dba5440268a11ee4939c348: Status 404 returned error can't find the container with id d636a762a5c970261068cfaae64a72cfb5032f5a4dba5440268a11ee4939c348 Jun 11 21:46:32.034034 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:32.034002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnn22" event={"ID":"10b62ea8-02f6-4334-aa25-10e13049b27f","Type":"ContainerStarted","Data":"d636a762a5c970261068cfaae64a72cfb5032f5a4dba5440268a11ee4939c348"} Jun 11 21:46:35.045604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.045565 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnn22" event={"ID":"10b62ea8-02f6-4334-aa25-10e13049b27f","Type":"ContainerStarted","Data":"cfd7e576139718eac09f8d7d8cfb7a43662a2578eb3dfb995f51980e1472847c"} Jun 11 21:46:35.203494 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.203466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:35.304716 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.304589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:35.405429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.405393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:35.505942 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.505912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:35.691230 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.691104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:35.883240 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:35.883204 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:36.051348 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.051311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnn22" event={"ID":"10b62ea8-02f6-4334-aa25-10e13049b27f","Type":"ContainerStarted","Data":"554b1d22b8cbcda8b154203c667c92014bc1ebf38122cc01d49de7bed5b2d1d4"} Jun 11 21:46:36.286234 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.286130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:36.388684 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.388572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:36.740254 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.740148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:36.834024 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.833987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:36.851531 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.851504 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:46:36.944441 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:36.944411 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.042211 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.042180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.056123 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.056098 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnn22" event={"ID":"10b62ea8-02f6-4334-aa25-10e13049b27f","Type":"ContainerStarted","Data":"2a0fb94057a0e33d39e4914746f42895ea458221b374c4d3a1b0d8a45d31fd90"} Jun 11 21:46:37.073224 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.073163 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gnn22" podStartSLOduration=16.434919362 podStartE2EDuration="22.073143635s" totalImagesPullingTime="5.638224273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:46:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:37.072530028 +0000 UTC m=+205.140301160" watchObservedRunningTime="2026-06-11 21:46:37.073143635 +0000 UTC m=+205.140914774" Jun 11 21:46:37.141766 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.141736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.303177 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.303098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.565591 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.565502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.752248 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.752205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:37.798849 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:37.798814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:38.306569 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:38.306531 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:39.089811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.089766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:39.124763 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.124723 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg"] Jun 11 21:46:39.127921 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.127904 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.129933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.129914 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:46:39.130638 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.130618 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 21:46:39.130768 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.130689 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:46:39.130768 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.130707 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dmdkj\"" Jun 11 21:46:39.130768 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.130759 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:46:39.130935 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.130818 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 21:46:39.135071 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.134639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg"] Jun 11 21:46:39.146545 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.146505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:39.238722 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.238685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee7643fe-eae0-4171-907a-7f53bec004e6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.238877 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.238727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.238877 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.238815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrvc\" (UniqueName: \"kubernetes.io/projected/ee7643fe-eae0-4171-907a-7f53bec004e6-kube-api-access-vlrvc\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.238877 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.238852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.321470 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.321429 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:39.339500 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.339475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrvc\" (UniqueName: \"kubernetes.io/projected/ee7643fe-eae0-4171-907a-7f53bec004e6-kube-api-access-vlrvc\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.339582 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.339508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.339732 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.339706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee7643fe-eae0-4171-907a-7f53bec004e6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.339797 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.339734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.340390 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.340340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee7643fe-eae0-4171-907a-7f53bec004e6-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.342006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.341986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.342079 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.342032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ee7643fe-eae0-4171-907a-7f53bec004e6-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.346538 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.346510 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrvc\" (UniqueName: \"kubernetes.io/projected/ee7643fe-eae0-4171-907a-7f53bec004e6-kube-api-access-vlrvc\") pod \"prometheus-operator-864fcfc6f9-hz5dg\" (UID: \"ee7643fe-eae0-4171-907a-7f53bec004e6\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.438020 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.437974 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" Jun 11 21:46:39.562649 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:39.562611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg"] Jun 11 21:46:39.565765 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:39.565734 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7643fe_eae0_4171_907a_7f53bec004e6.slice/crio-de06eb69815c6d5f670b5ba7480f8c2ae8877b0ba8759e326bac249bd8155db5 WatchSource:0}: Error finding container de06eb69815c6d5f670b5ba7480f8c2ae8877b0ba8759e326bac249bd8155db5: Status 404 returned error can't find the container with id de06eb69815c6d5f670b5ba7480f8c2ae8877b0ba8759e326bac249bd8155db5 Jun 11 21:46:40.070620 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:40.070587 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" event={"ID":"ee7643fe-eae0-4171-907a-7f53bec004e6","Type":"ContainerStarted","Data":"de06eb69815c6d5f670b5ba7480f8c2ae8877b0ba8759e326bac249bd8155db5"} Jun 11 21:46:40.903743 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:40.903709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:41.075916 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:41.075876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" event={"ID":"ee7643fe-eae0-4171-907a-7f53bec004e6","Type":"ContainerStarted","Data":"3b22812fc188a9f6c0cb79494dfef47e5d57e950c15325f6d8ccc538661aa7fb"} Jun 11 21:46:41.076083 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:41.075930 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" event={"ID":"ee7643fe-eae0-4171-907a-7f53bec004e6","Type":"ContainerStarted","Data":"f6dcf6d5940207754aefeb8b0f516e4f8eaad709701d91c77c4d1743c115546c"} Jun 11 21:46:41.089823 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:41.089771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-hz5dg" podStartSLOduration=0.998608266 podStartE2EDuration="2.089755809s" totalImagesPullingTime="1.091147543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:41.088482907 +0000 UTC m=+209.156254033" watchObservedRunningTime="2026-06-11 21:46:41.089755809 +0000 UTC m=+209.157526943" Jun 11 21:46:42.265927 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:42.265889 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:42.268398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:42.268376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11c31e7-b296-497a-acbf-efdbf6e33fc9-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-pc5lv\" (UID: \"c11c31e7-b296-497a-acbf-efdbf6e33fc9\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:42.479993 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:42.479961 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-md8ws\"" Jun 11 21:46:42.489174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:42.489151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" Jun 11 21:46:42.611931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:42.611900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-pc5lv"] Jun 11 21:46:42.614582 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:42.614554 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11c31e7_b296_497a_acbf_efdbf6e33fc9.slice/crio-4bad6f4d35515dc10ad0d738d5eeeb652fe81118a995d8476136fbf55c4d37f9 WatchSource:0}: Error finding container 4bad6f4d35515dc10ad0d738d5eeeb652fe81118a995d8476136fbf55c4d37f9: Status 404 returned error can't find the container with id 4bad6f4d35515dc10ad0d738d5eeeb652fe81118a995d8476136fbf55c4d37f9 Jun 11 21:46:43.083173 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.083134 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" event={"ID":"c11c31e7-b296-497a-acbf-efdbf6e33fc9","Type":"ContainerStarted","Data":"4bad6f4d35515dc10ad0d738d5eeeb652fe81118a995d8476136fbf55c4d37f9"} Jun 11 21:46:43.209623 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.209577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.445604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.445506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.468271 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.468236 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8rjxp"] Jun 11 21:46:43.471492 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.471468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473685 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-sys\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kfm\" (UniqueName: \"kubernetes.io/projected/efde7a37-1390-4465-94fc-80d45de68e10-kube-api-access-j6kfm\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-root\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-textfile\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-wtmp\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.473962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.473935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-metrics-client-ca\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.474278 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.474255 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:46:43.474374 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.474305 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:46:43.474472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.474459 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:46:43.474603 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.474586 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xczvw\"" Jun 11 21:46:43.516890 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.516839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.575103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.574929 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-sys\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575045 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kfm\" (UniqueName: \"kubernetes.io/projected/efde7a37-1390-4465-94fc-80d45de68e10-kube-api-access-j6kfm\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-root\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-textfile\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575221 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-wtmp\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-metrics-client-ca\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575689 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575493 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-root\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575689 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:43.575608 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 21:46:43.575784 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:46:43.575695 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls podName:efde7a37-1390-4465-94fc-80d45de68e10 nodeName:}" failed. No retries permitted until 2026-06-11 21:46:44.075675628 +0000 UTC m=+212.143446744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls") pod "node-exporter-8rjxp" (UID: "efde7a37-1390-4465-94fc-80d45de68e10") : secret "node-exporter-tls" not found Jun 11 21:46:43.575942 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-accelerators-collector-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.575942 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efde7a37-1390-4465-94fc-80d45de68e10-metrics-client-ca\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.576055 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.575990 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-sys\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.576055 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.576036 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-wtmp\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.576347 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.576326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-textfile\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.578401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.578358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.583254 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.583224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kfm\" (UniqueName: \"kubernetes.io/projected/efde7a37-1390-4465-94fc-80d45de68e10-kube-api-access-j6kfm\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:43.688037 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.688003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.786312 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.786271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.886107 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.886052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:43.987389 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:43.987360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.079613 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.079587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:44.081795 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.081778 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efde7a37-1390-4465-94fc-80d45de68e10-node-exporter-tls\") pod \"node-exporter-8rjxp\" (UID: \"efde7a37-1390-4465-94fc-80d45de68e10\") " pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:44.083809 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.083791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8rjxp" Jun 11 21:46:44.087781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.087755 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" event={"ID":"c11c31e7-b296-497a-acbf-efdbf6e33fc9","Type":"ContainerStarted","Data":"6ef864398221d1835d858364a3bc890eb28ca7102900f40ed3df402750512f29"} Jun 11 21:46:44.096270 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:44.096250 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefde7a37_1390_4465_94fc_80d45de68e10.slice/crio-45386cccb64e2ff7f9372f49d4bcbe47d739aab7ae049a934bd1279458429e96 WatchSource:0}: Error finding container 45386cccb64e2ff7f9372f49d4bcbe47d739aab7ae049a934bd1279458429e96: Status 404 returned error can't find the container with id 45386cccb64e2ff7f9372f49d4bcbe47d739aab7ae049a934bd1279458429e96 Jun 11 21:46:44.101566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.101530 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-pc5lv" podStartSLOduration=32.742400541 podStartE2EDuration="34.101516303s" totalImagesPullingTime="1.359115762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:44.100149351 +0000 UTC m=+212.167920487" watchObservedRunningTime="2026-06-11 21:46:44.101516303 +0000 UTC m=+212.169287441" Jun 11 21:46:44.130758 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.130723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.233960 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.233921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.323643 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.323557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.447932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.447901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.541275 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.541239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:44.683904 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:44.683816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:45.093580 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:45.093541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rjxp" event={"ID":"efde7a37-1390-4465-94fc-80d45de68e10","Type":"ContainerStarted","Data":"45386cccb64e2ff7f9372f49d4bcbe47d739aab7ae049a934bd1279458429e96"} Jun 11 21:46:46.098390 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.098355 2581 generic.go:356] "Generic (PLEG): container finished" podID="efde7a37-1390-4465-94fc-80d45de68e10" containerID="98450a44a1d748c4f45aa15a818e1d96453e4d4dfea9a34f1a7fda9b20ce4e0c" exitCode=0 Jun 11 21:46:46.098804 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.098442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rjxp" event={"ID":"efde7a37-1390-4465-94fc-80d45de68e10","Type":"ContainerDied","Data":"98450a44a1d748c4f45aa15a818e1d96453e4d4dfea9a34f1a7fda9b20ce4e0c"} Jun 11 21:46:46.367525 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.367428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:46.444805 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.444759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:46.448430 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.448406 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b48b845cb-xq4rt"] Jun 11 21:46:46.451041 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.451025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.453071 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453044 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 21:46:46.453183 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453095 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 21:46:46.453183 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453140 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 21:46:46.453297 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453281 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7a01n47v54fc9\"" Jun 11 21:46:46.453356 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453338 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 21:46:46.453471 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 21:46:46.453578 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.453469 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2vmdx\"" Jun 11 21:46:46.463196 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.463167 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b48b845cb-xq4rt"] Jun 11 21:46:46.505077 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505205 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77899376-eb76-40fe-82cb-be958a183223-metrics-client-ca\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4zp4\" (UniqueName: \"kubernetes.io/projected/77899376-eb76-40fe-82cb-be958a183223-kube-api-access-b4zp4\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.505441 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.505417 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-grpc-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606132 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4zp4\" (UniqueName: \"kubernetes.io/projected/77899376-eb76-40fe-82cb-be958a183223-kube-api-access-b4zp4\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-grpc-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606229 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606279 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.606503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.606398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77899376-eb76-40fe-82cb-be958a183223-metrics-client-ca\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.607824 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.607730 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77899376-eb76-40fe-82cb-be958a183223-metrics-client-ca\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.611221 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.610007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.613837 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.613809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4zp4\" (UniqueName: \"kubernetes.io/projected/77899376-eb76-40fe-82cb-be958a183223-kube-api-access-b4zp4\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.617274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.616405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.617274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.616531 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.617274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.616791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-grpc-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.617274 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.616827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-tls\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.619003 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.618948 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/77899376-eb76-40fe-82cb-be958a183223-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b48b845cb-xq4rt\" (UID: \"77899376-eb76-40fe-82cb-be958a183223\") " pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.691650 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.691609 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:46.761072 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.761028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:46.860106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.860063 2581 patch_prober.go:28] interesting pod/image-registry-5df7d978fd-gznk8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:46:46.860229 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.860130 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:46:46.901923 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.901851 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b48b845cb-xq4rt"] Jun 11 21:46:46.904762 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:46.904722 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77899376_eb76_40fe_82cb_be958a183223.slice/crio-0d1a5052ccebb8011b3c941c7b78d306f2b7fd83cd2d9071b84675f4844b686d WatchSource:0}: Error finding container 0d1a5052ccebb8011b3c941c7b78d306f2b7fd83cd2d9071b84675f4844b686d: Status 404 returned error can't find the container with id 0d1a5052ccebb8011b3c941c7b78d306f2b7fd83cd2d9071b84675f4844b686d Jun 11 21:46:46.908836 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:46.908808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:47.103790 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:47.103752 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rjxp" event={"ID":"efde7a37-1390-4465-94fc-80d45de68e10","Type":"ContainerStarted","Data":"debdedfb2e9e996cb43a24fb38907064726215d87efd78bc7ce3c2a10cf22cc1"} Jun 11 21:46:47.104183 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:47.103807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8rjxp" event={"ID":"efde7a37-1390-4465-94fc-80d45de68e10","Type":"ContainerStarted","Data":"919d38c313c4af99bf957d6ca4c6ebb9e0501f6ff2b8729365297d044115e2f5"} Jun 11 21:46:47.104940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:47.104920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"0d1a5052ccebb8011b3c941c7b78d306f2b7fd83cd2d9071b84675f4844b686d"} Jun 11 21:46:47.120724 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:47.120676 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8rjxp" podStartSLOduration=2.969531982 podStartE2EDuration="4.120648328s" totalImagesPullingTime="1.075663027s" totalInitContainerRuntime="75.453319ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:47.118929898 +0000 UTC m=+215.186701035" watchObservedRunningTime="2026-06-11 21:46:47.120648328 +0000 UTC m=+215.188419459" Jun 11 21:46:47.987454 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:47.987417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:48.046067 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:48.046031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:48.229582 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:48.229543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:48.288163 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:48.288123 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:48.391257 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:48.391218 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:49.516731 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.516695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:49.647218 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.647162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:49.652018 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.651992 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:46:49.656369 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.656067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.658714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.658347 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 21:46:49.658839 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.658744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 21:46:49.658839 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.658760 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 21:46:49.659200 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.658974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 21:46:49.659200 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659083 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 21:46:49.659200 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659091 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 21:46:49.659403 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659328 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 21:46:49.659403 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659384 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659590 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m227k\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659597 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659620 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659767 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659871 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 21:46:49.660006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.659991 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 21:46:49.661039 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.660391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 21:46:49.661039 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.660538 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6r4rhaksa46q\"" Jun 11 21:46:49.661595 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.661574 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 21:46:49.670788 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.670567 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734931 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.734980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736087 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhs4\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.736940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.735300 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836363 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836363 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhs4\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836363 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.836628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.836967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.837114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.837515 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.837835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.837599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.838408 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.838378 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.840452 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.840412 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.840785 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.840761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.840982 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.840958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.841550 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.841524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.841641 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.841521 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842296 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842222 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842409 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842355 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842957 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842492 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842957 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842957 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.842957 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.842915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.843635 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.843246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.843635 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.843590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.844495 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.844473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhs4\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.845015 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.844976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.846437 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.846418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:49.967908 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:49.967871 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:46:50.119478 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:50.119385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"e64bfb6d4a71311835301d03364e4c6810c016309e8921db8088300b044fa57b"} Jun 11 21:46:50.119478 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:50.119477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"095bce539f5a00f3338c7a6f32a84237797c998ab4e5e613fa1dace4eed7e94c"} Jun 11 21:46:50.119738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:50.119503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"9b1d22aecc54a8cebe77356731bfb270aecbfb9c70fc03737a474559febebcee"} Jun 11 21:46:50.124135 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:50.124102 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:46:50.127416 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:46:50.127390 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefeab228_3db1_470e_8936_02371d16d8d4.slice/crio-c4a590d01aea56852ac277335deabee0995f7bf2199edcd0fc38b67f8718674e WatchSource:0}: Error finding container c4a590d01aea56852ac277335deabee0995f7bf2199edcd0fc38b67f8718674e: Status 404 returned error can't find the container with id c4a590d01aea56852ac277335deabee0995f7bf2199edcd0fc38b67f8718674e Jun 11 21:46:51.123800 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.123772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"c4a590d01aea56852ac277335deabee0995f7bf2199edcd0fc38b67f8718674e"} Jun 11 21:46:51.126992 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.126969 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"c0c77bba0db337508f9013c5d941cbd3dfabf487a6f84b55163cd11f828037e0"} Jun 11 21:46:51.127078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.127029 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"4f98a13e570b8b4361a3960401f60c778a9c0e1f8268a3a5621595d5027300cb"} Jun 11 21:46:51.127078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.127064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" event={"ID":"77899376-eb76-40fe-82cb-be958a183223","Type":"ContainerStarted","Data":"d9702e5eb300e6115a2c769207855a9c85c2461b695aeba1d46e8e58673396c7"} Jun 11 21:46:51.127191 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.127115 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:51.146562 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:51.146517 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" podStartSLOduration=1.815231367 podStartE2EDuration="5.146502769s" totalImagesPullingTime="3.331271402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:51.144809316 +0000 UTC m=+219.212580451" watchObservedRunningTime="2026-06-11 21:46:51.146502769 +0000 UTC m=+219.214273905" Jun 11 21:46:52.132817 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:52.132778 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" exitCode=0 Jun 11 21:46:52.133284 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:52.132862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} Jun 11 21:46:53.120758 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:53.120716 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:53.221807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:53.221765 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:56.151499 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} Jun 11 21:46:56.151895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151529 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} Jun 11 21:46:56.151895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151566 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} Jun 11 21:46:56.151895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} Jun 11 21:46:56.151895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} Jun 11 21:46:56.151895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.151644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerStarted","Data":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} Jun 11 21:46:56.179572 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.179507 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.097673246 podStartE2EDuration="7.179487003s" totalImagesPullingTime="4.061302246s" totalInitContainerRuntime="20.511511ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:46:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:46:56.177217797 +0000 UTC m=+224.244988931" watchObservedRunningTime="2026-06-11 21:46:56.179487003 +0000 UTC m=+224.247258139" Jun 11 21:46:56.856412 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.856373 2581 patch_prober.go:28] interesting pod/image-registry-5df7d978fd-gznk8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:46:56.856570 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:56.856426 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:46:57.138375 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:57.138301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b48b845cb-xq4rt" Jun 11 21:46:58.104140 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:58.104105 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:58.153867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:58.153836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:58.317955 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:58.317923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:58.365596 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:58.365521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:46:59.968169 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:46:59.968137 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:47:01.875815 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:01.875772 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" containerID="cri-o://eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275" gracePeriod=30 Jun 11 21:47:01.972202 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:01.972170 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:02.020539 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.020502 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:02.118744 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.118725 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:47:02.175821 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.175744 2581 generic.go:356] "Generic (PLEG): container finished" podID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerID="eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275" exitCode=0 Jun 11 21:47:02.175821 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.175781 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" Jun 11 21:47:02.175821 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.175800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" event={"ID":"2d66fbe2-e86b-4c30-bd9d-63461f766382","Type":"ContainerDied","Data":"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275"} Jun 11 21:47:02.176081 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.175870 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5df7d978fd-gznk8" event={"ID":"2d66fbe2-e86b-4c30-bd9d-63461f766382","Type":"ContainerDied","Data":"96da70ac7d1464ae173891a6a039662b6bd49d1396bba3c8714727f08d4e47c5"} Jun 11 21:47:02.176081 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.175900 2581 scope.go:117] "RemoveContainer" containerID="eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275" Jun 11 21:47:02.185596 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.185575 2581 scope.go:117] "RemoveContainer" containerID="eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275" Jun 11 21:47:02.185878 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:47:02.185856 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275\": container with ID starting with eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275 not found: ID does not exist" containerID="eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275" Jun 11 21:47:02.185946 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.185885 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275"} err="failed to get container status \"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275\": rpc error: code = NotFound desc = could not find container \"eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275\": container with ID starting with eb936fe2e902ee6732a9fecaf8fec26fe10ed32b1de2a3b253786bb561978275 not found: ID does not exist" Jun 11 21:47:02.252294 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252258 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252294 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252296 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252350 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252378 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252458 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252497 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ff4j\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252769 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252530 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token\") pod \"2d66fbe2-e86b-4c30-bd9d-63461f766382\" (UID: \"2d66fbe2-e86b-4c30-bd9d-63461f766382\") " Jun 11 21:47:02.252769 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252742 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:47:02.252884 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252866 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-certificates\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.252947 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.252874 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:47:02.254984 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.254951 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:47:02.255195 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.255160 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j" (OuterVolumeSpecName: "kube-api-access-8ff4j") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "kube-api-access-8ff4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:47:02.255310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.255274 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:47:02.255310 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.255273 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:47:02.255428 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.255409 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:47:02.261015 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.260993 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2d66fbe2-e86b-4c30-bd9d-63461f766382" (UID: "2d66fbe2-e86b-4c30-bd9d-63461f766382"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:47:02.353518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353482 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d66fbe2-e86b-4c30-bd9d-63461f766382-trusted-ca\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353511 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-registry-tls\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353520 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-installation-pull-secrets\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353529 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d66fbe2-e86b-4c30-bd9d-63461f766382-image-registry-private-configuration\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353539 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ff4j\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-kube-api-access-8ff4j\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353548 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d66fbe2-e86b-4c30-bd9d-63461f766382-bound-sa-token\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.353778 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.353557 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d66fbe2-e86b-4c30-bd9d-63461f766382-ca-trust-extracted\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:47:02.490468 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.490391 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:47:02.495119 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:02.495093 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5df7d978fd-gznk8"] Jun 11 21:47:04.394748 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:04.394717 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" path="/var/lib/kubelet/pods/2d66fbe2-e86b-4c30-bd9d-63461f766382/volumes" Jun 11 21:47:11.324211 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:11.324173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:11.371846 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:11.371816 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:11.923862 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:11.923818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:11.973161 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:11.973133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:20.251841 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:20.251804 2581 generic.go:356] "Generic (PLEG): container finished" podID="03928bf9-3655-4af2-b415-05d3351ecb09" containerID="af13f5725b29a8a0ec6bcc6d94eb899381be4d399eeb5f0a4c760470d38cc2cb" exitCode=0 Jun 11 21:47:20.252364 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:20.251860 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" event={"ID":"03928bf9-3655-4af2-b415-05d3351ecb09","Type":"ContainerDied","Data":"af13f5725b29a8a0ec6bcc6d94eb899381be4d399eeb5f0a4c760470d38cc2cb"} Jun 11 21:47:20.252364 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:20.252147 2581 scope.go:117] "RemoveContainer" containerID="af13f5725b29a8a0ec6bcc6d94eb899381be4d399eeb5f0a4c760470d38cc2cb" Jun 11 21:47:21.003425 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:21.003383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:21.052134 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:21.052097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:21.258239 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:21.258157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-wlz8d" event={"ID":"03928bf9-3655-4af2-b415-05d3351ecb09","Type":"ContainerStarted","Data":"1b1f8f84717b430a872784e7d068b08517058f5fff4fd7897e210f825a4b177e"} Jun 11 21:47:22.765064 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:22.765020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:22.823715 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:22.823678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:24.235985 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:24.235947 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:47:24.238401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:24.238382 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/889db87a-4683-4dc3-9f77-6f624179cfcd-metrics-certs\") pod \"network-metrics-daemon-4zm4q\" (UID: \"889db87a-4683-4dc3-9f77-6f624179cfcd\") " pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:47:24.392355 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:24.392326 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrlsh\"" Jun 11 21:47:24.400946 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:24.400921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4zm4q" Jun 11 21:47:24.526239 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:24.526206 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4zm4q"] Jun 11 21:47:24.529050 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:47:24.529018 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889db87a_4683_4dc3_9f77_6f624179cfcd.slice/crio-0111fe6aa63ac2612fbe021b47f578bf3964f45c88e9ee1ed649f4f4bcc1996a WatchSource:0}: Error finding container 0111fe6aa63ac2612fbe021b47f578bf3964f45c88e9ee1ed649f4f4bcc1996a: Status 404 returned error can't find the container with id 0111fe6aa63ac2612fbe021b47f578bf3964f45c88e9ee1ed649f4f4bcc1996a Jun 11 21:47:25.273421 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:25.273383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zm4q" event={"ID":"889db87a-4683-4dc3-9f77-6f624179cfcd","Type":"ContainerStarted","Data":"0111fe6aa63ac2612fbe021b47f578bf3964f45c88e9ee1ed649f4f4bcc1996a"} Jun 11 21:47:26.260249 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.260217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/init-textfile/0.log" Jun 11 21:47:26.278687 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.278634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zm4q" event={"ID":"889db87a-4683-4dc3-9f77-6f624179cfcd","Type":"ContainerStarted","Data":"6ca7031c5eccb658bc1377ee97cbe22d8ce7ac2e84b5fea549e9cde0fea8c4a4"} Jun 11 21:47:26.279134 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.278716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4zm4q" event={"ID":"889db87a-4683-4dc3-9f77-6f624179cfcd","Type":"ContainerStarted","Data":"2143196dc2dbf6bd4da210d347f75f44e9250604a493b4328c95630c31579407"} Jun 11 21:47:26.292587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.292533 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4zm4q" podStartSLOduration=253.302050396 podStartE2EDuration="4m14.292514265s" totalImagesPullingTime="990.463869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:26.292473542 +0000 UTC m=+254.360244681" watchObservedRunningTime="2026-06-11 21:47:26.292514265 +0000 UTC m=+254.360285401" Jun 11 21:47:26.373094 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.373047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:26.421550 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.421504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:26.461580 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.461540 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/node-exporter/0.log" Jun 11 21:47:26.660165 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:26.660080 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/kube-rbac-proxy/0.log" Jun 11 21:47:28.060840 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:28.060808 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/init-config-reloader/0.log" Jun 11 21:47:28.261627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:28.261599 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/prometheus/0.log" Jun 11 21:47:28.460891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:28.460806 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/config-reloader/0.log" Jun 11 21:47:28.660675 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:28.660635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/thanos-sidecar/0.log" Jun 11 21:47:28.861490 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:28.861463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/kube-rbac-proxy-web/0.log" Jun 11 21:47:29.060620 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:29.060551 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/kube-rbac-proxy/0.log" Jun 11 21:47:29.259877 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:29.259853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efeab228-3db1-470e-8936-02371d16d8d4/kube-rbac-proxy-thanos/0.log" Jun 11 21:47:29.462580 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:29.462552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-hz5dg_ee7643fe-eae0-4171-907a-7f53bec004e6/prometheus-operator/0.log" Jun 11 21:47:29.660577 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:29.660494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-hz5dg_ee7643fe-eae0-4171-907a-7f53bec004e6/kube-rbac-proxy/0.log" Jun 11 21:47:30.060840 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.060812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/thanos-query/0.log" Jun 11 21:47:30.259961 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.259927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-web/0.log" Jun 11 21:47:30.461173 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.461090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy/0.log" Jun 11 21:47:30.556628 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.556597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:30.606110 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.606080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:30.660162 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.660138 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/prom-label-proxy/0.log" Jun 11 21:47:30.860755 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:30.860723 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-rules/0.log" Jun 11 21:47:31.061179 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:31.061149 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-metrics/0.log" Jun 11 21:47:31.260422 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:31.260394 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-pc5lv_c11c31e7-b296-497a-acbf-efdbf6e33fc9/networking-console-plugin/0.log" Jun 11 21:47:33.660739 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:33.660714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l9zrf_386b7758-2d4f-4e98-bc8a-688929d3e998/dns-node-resolver/0.log" Jun 11 21:47:34.659780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:34.659755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b6d6_da4b4611-50bd-48e4-91e7-3d724f3159d4/node-ca/0.log" Jun 11 21:47:35.261466 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:35.261435 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log" Jun 11 21:47:35.460790 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:35.460761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpz6t_3c9f259d-d75b-4318-bc9c-47a70786d29c/serve-healthcheck-canary/0.log" Jun 11 21:47:39.336007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:39.335978 2581 generic.go:356] "Generic (PLEG): container finished" podID="9be3abdd-3c50-4c8f-b082-25260bcd9e1d" containerID="c04fa34a147a57355e12eda8dc6b6827b993c8a2bec8d0623c830b1bbccee94a" exitCode=0 Jun 11 21:47:39.336425 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:39.336052 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" event={"ID":"9be3abdd-3c50-4c8f-b082-25260bcd9e1d","Type":"ContainerDied","Data":"c04fa34a147a57355e12eda8dc6b6827b993c8a2bec8d0623c830b1bbccee94a"} Jun 11 21:47:39.336490 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:39.336452 2581 scope.go:117] "RemoveContainer" containerID="c04fa34a147a57355e12eda8dc6b6827b993c8a2bec8d0623c830b1bbccee94a" Jun 11 21:47:40.162440 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:40.162406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:40.342253 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:40.342223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9dbww" event={"ID":"9be3abdd-3c50-4c8f-b082-25260bcd9e1d","Type":"ContainerStarted","Data":"76f3ac1c43bae862c27ac2bb20eeacc681a8be4408bd098cc7e8d196510e74b8"} Jun 11 21:47:42.587787 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:42.587752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:42.635579 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:42.635535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:42.688247 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:42.688210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.128887 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.128856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.180541 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.180512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.296531 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.296498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.346493 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.346458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.452476 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.452382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:43.553004 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:43.552965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:49.968034 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:49.967994 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:47:49.984239 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:49.984215 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:47:50.395268 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:50.395240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:47:52.027838 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:52.027795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:52.080592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:52.080568 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:47:53.894108 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:47:53.894043 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-94ddb" podUID="7689cdfb-5638-4ca9-99dd-4a379f1b4a69" Jun 11 21:47:54.394202 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:54.394171 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94ddb" Jun 11 21:47:57.332345 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:57.332305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:47:57.334774 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:57.334753 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7689cdfb-5638-4ca9-99dd-4a379f1b4a69-metrics-tls\") pod \"dns-default-94ddb\" (UID: \"7689cdfb-5638-4ca9-99dd-4a379f1b4a69\") " pod="openshift-dns/dns-default-94ddb" Jun 11 21:47:57.397119 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:57.397092 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-td5zs\"" Jun 11 21:47:57.405443 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:57.405424 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-94ddb" Jun 11 21:47:57.537870 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:57.537828 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-94ddb"] Jun 11 21:47:57.540402 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:47:57.540377 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7689cdfb_5638_4ca9_99dd_4a379f1b4a69.slice/crio-4c41de797c843056f7c7c5f83ece425639972719c723dbe6a1aec5c218597b7a WatchSource:0}: Error finding container 4c41de797c843056f7c7c5f83ece425639972719c723dbe6a1aec5c218597b7a: Status 404 returned error can't find the container with id 4c41de797c843056f7c7c5f83ece425639972719c723dbe6a1aec5c218597b7a Jun 11 21:47:58.411795 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:58.411760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94ddb" event={"ID":"7689cdfb-5638-4ca9-99dd-4a379f1b4a69","Type":"ContainerStarted","Data":"4c41de797c843056f7c7c5f83ece425639972719c723dbe6a1aec5c218597b7a"} Jun 11 21:47:59.417154 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:59.417118 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94ddb" event={"ID":"7689cdfb-5638-4ca9-99dd-4a379f1b4a69","Type":"ContainerStarted","Data":"d65582e5663c61a090e5a49152b0544b56d3870a4774ab97d2822ed6fcff9ae1"} Jun 11 21:47:59.417636 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:59.417179 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-94ddb" event={"ID":"7689cdfb-5638-4ca9-99dd-4a379f1b4a69","Type":"ContainerStarted","Data":"aa041d1101dfa08d8efde7185f2d1f06bfc9177f4baa8455426adf766b50c7a7"} Jun 11 21:47:59.417636 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:59.417291 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-94ddb" Jun 11 21:47:59.433965 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:47:59.433782 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-94ddb" podStartSLOduration=250.988830056 podStartE2EDuration="4m12.433766918s" totalImagesPullingTime="1.444936862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:47:59.433591308 +0000 UTC m=+287.501362445" watchObservedRunningTime="2026-06-11 21:47:59.433766918 +0000 UTC m=+287.501538053" Jun 11 21:48:01.123306 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:01.123254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:01.229983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:01.229947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:02.639954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:02.639905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:02.750372 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:02.750310 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:05.101037 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:05.101005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:05.202987 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:05.202951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:05.301692 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:05.301638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:07.779434 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:07.779400 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:07.976016 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:07.975973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:08.043276 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043183 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043567 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="prometheus" containerID="cri-o://5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" gracePeriod=600 Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043584 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy" containerID="cri-o://bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" gracePeriod=600 Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043622 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="config-reloader" containerID="cri-o://d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" gracePeriod=600 Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043611 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="thanos-sidecar" containerID="cri-o://f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" gracePeriod=600 Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043631 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-web" containerID="cri-o://bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" gracePeriod=600 Jun 11 21:48:08.043776 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.043690 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" gracePeriod=600 Jun 11 21:48:08.308818 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.308790 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.429221 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429191 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429226 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429255 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429278 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429302 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhs4\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429337 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429392 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429371 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429407 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429436 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429459 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429496 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429551 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429580 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429617 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429649 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.429721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429709 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.430204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429744 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.430204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429776 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.430204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429781 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.430204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.429804 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config\") pod \"efeab228-3db1-470e-8936-02371d16d8d4\" (UID: \"efeab228-3db1-470e-8936-02371d16d8d4\") " Jun 11 21:48:08.430204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.430148 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.430455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.430227 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.430455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.430248 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.432402 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432346 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.432402 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432376 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.432563 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432425 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.432563 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432439 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config" (OuterVolumeSpecName: "config") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.432761 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432734 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.432852 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432831 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.432852 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432842 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.433022 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.432996 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.433249 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.433227 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.433580 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.433425 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4" (OuterVolumeSpecName: "kube-api-access-lmhs4") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "kube-api-access-lmhs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:08.433698 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.433678 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:48:08.434445 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.434416 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:48:08.434821 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.434794 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.435013 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.434982 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.435013 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.434999 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out" (OuterVolumeSpecName: "config-out") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:48:08.435279 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.435262 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:48:08.435557 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.435537 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.444164 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.444144 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config" (OuterVolumeSpecName: "web-config") pod "efeab228-3db1-470e-8936-02371d16d8d4" (UID: "efeab228-3db1-470e-8936-02371d16d8d4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:48:08.452952 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452927 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" exitCode=0 Jun 11 21:48:08.452952 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452951 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" exitCode=0 Jun 11 21:48:08.453078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452960 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" exitCode=0 Jun 11 21:48:08.453078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452966 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" exitCode=0 Jun 11 21:48:08.453078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452971 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" exitCode=0 Jun 11 21:48:08.453078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.452976 2581 generic.go:356] "Generic (PLEG): container finished" podID="efeab228-3db1-470e-8936-02371d16d8d4" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" exitCode=0 Jun 11 21:48:08.453078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453013 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.453225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} Jun 11 21:48:08.453225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} Jun 11 21:48:08.453225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} Jun 11 21:48:08.453225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453191 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} Jun 11 21:48:08.453225 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} Jun 11 21:48:08.453372 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453209 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.453372 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} Jun 11 21:48:08.453372 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.453264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efeab228-3db1-470e-8936-02371d16d8d4","Type":"ContainerDied","Data":"c4a590d01aea56852ac277335deabee0995f7bf2199edcd0fc38b67f8718674e"} Jun 11 21:48:08.461281 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.461264 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.468336 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.468316 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.475524 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.475506 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.477184 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.477157 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.480174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.480152 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.485181 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.485161 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.492241 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.492223 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.499341 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.499324 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.506290 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.506275 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.506530 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.506513 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.506590 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.506538 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.506590 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.506556 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.506781 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.506766 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.506828 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.506784 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.506828 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.506796 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.506996 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.506975 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.507063 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507004 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.507063 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507023 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.507471 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.507444 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.507589 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507476 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.507589 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507498 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.507873 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.507823 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.507873 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507852 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.507873 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.507873 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.508191 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.508168 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.508290 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508199 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.508290 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508218 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.508512 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:48:08.508476 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.508590 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508507 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.508590 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508526 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.508851 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508832 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.508895 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.508853 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.509077 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509062 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.509077 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509077 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.509282 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509263 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.509282 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509280 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.509416 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509337 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.509510 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509493 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.509553 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509511 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.509647 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509631 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" Jun 11 21:48:08.509714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509668 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" Jun 11 21:48:08.509714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509681 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="config-reloader" Jun 11 21:48:08.509714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509689 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="config-reloader" Jun 11 21:48:08.509714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509698 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="init-config-reloader" Jun 11 21:48:08.509714 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509708 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="init-config-reloader" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509721 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-web" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509730 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-web" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509743 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="thanos-sidecar" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509749 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="thanos-sidecar" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509761 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509766 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509772 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-thanos" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509765 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509793 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509777 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-thanos" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509858 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="prometheus" Jun 11 21:48:08.509933 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509869 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="prometheus" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509956 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-web" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509969 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy-thanos" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509978 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d66fbe2-e86b-4c30-bd9d-63461f766382" containerName="registry" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509989 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="config-reloader" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.509998 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="kube-rbac-proxy" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510008 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="prometheus" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510016 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efeab228-3db1-470e-8936-02371d16d8d4" containerName="thanos-sidecar" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510020 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510036 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510236 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510251 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510421 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.510474 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510435 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510582 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510596 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510762 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510775 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510968 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.511129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.510980 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.511406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511154 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.511406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511168 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.511406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511321 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.511406 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511334 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.511587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511515 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.511587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511529 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.511750 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511730 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.511786 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511750 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.511934 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511918 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.511970 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.511935 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.512141 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512125 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.512179 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512142 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.512315 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.512348 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512315 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.512487 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512468 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.512487 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512484 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.512688 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512672 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.512688 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512687 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.512878 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512861 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.512878 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.512875 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.513078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513062 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.513078 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513077 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.513260 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513245 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.513298 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513261 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.513464 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513444 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.513514 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513466 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.513685 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513647 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.513754 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513686 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.513949 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513926 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.514011 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.513952 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.514222 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514202 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.514298 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514223 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.514481 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514457 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.514481 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514477 2581 scope.go:117] "RemoveContainer" containerID="04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0" Jun 11 21:48:08.516446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514906 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0"} err="failed to get container status \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": rpc error: code = NotFound desc = could not find container \"04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0\": container with ID starting with 04d0c2a27de9a0a8bdd1e304585b5c0919eff11e74ba4598a9f7c6936bad06a0 not found: ID does not exist" Jun 11 21:48:08.516446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.514951 2581 scope.go:117] "RemoveContainer" containerID="bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb" Jun 11 21:48:08.516446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.516073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.517093 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517071 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb"} err="failed to get container status \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": rpc error: code = NotFound desc = could not find container \"bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb\": container with ID starting with bee5a0efb4c7e365a6a513c3915ab370edd65908d288341b165bccc170229acb not found: ID does not exist" Jun 11 21:48:08.517188 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517093 2581 scope.go:117] "RemoveContainer" containerID="bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71" Jun 11 21:48:08.517369 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517339 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71"} err="failed to get container status \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": rpc error: code = NotFound desc = could not find container \"bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71\": container with ID starting with bcc6f1575380b3a01a5b08c59e37f4b46646bc83914f4e244b498db67b443e71 not found: ID does not exist" Jun 11 21:48:08.517423 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517370 2581 scope.go:117] "RemoveContainer" containerID="f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569" Jun 11 21:48:08.517604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517585 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569"} err="failed to get container status \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": rpc error: code = NotFound desc = could not find container \"f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569\": container with ID starting with f096bdc00955b9ff161c91c279acbe856ee550022078b29db104a2d66a4e0569 not found: ID does not exist" Jun 11 21:48:08.517680 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517606 2581 scope.go:117] "RemoveContainer" containerID="d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb" Jun 11 21:48:08.517833 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517816 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb"} err="failed to get container status \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": rpc error: code = NotFound desc = could not find container \"d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb\": container with ID starting with d3e527043998b848a1bb9377829503db374374a34cdcf6e232ef604941bb0ddb not found: ID does not exist" Jun 11 21:48:08.517883 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.517833 2581 scope.go:117] "RemoveContainer" containerID="5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244" Jun 11 21:48:08.518060 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518036 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244"} err="failed to get container status \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": rpc error: code = NotFound desc = could not find container \"5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244\": container with ID starting with 5edd8a51919cfbfb9fd91a919260dd2310e0b0b562e1593d2e0387bdbb0b2244 not found: ID does not exist" Jun 11 21:48:08.518113 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518060 2581 scope.go:117] "RemoveContainer" containerID="086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254" Jun 11 21:48:08.518375 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518352 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254"} err="failed to get container status \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": rpc error: code = NotFound desc = could not find container \"086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254\": container with ID starting with 086c92280ed40f84a29f9607acd57a342db93d1e64aee1db3179c51918960254 not found: ID does not exist" Jun 11 21:48:08.518506 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518490 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 21:48:08.518700 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518646 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 21:48:08.518856 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518841 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m227k\"" Jun 11 21:48:08.518924 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518852 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 21:48:08.518924 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.518899 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 21:48:08.519018 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519006 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 21:48:08.519140 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519127 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6r4rhaksa46q\"" Jun 11 21:48:08.519246 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 21:48:08.519333 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519306 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 21:48:08.519407 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519361 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 21:48:08.519593 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 21:48:08.519593 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.519556 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 21:48:08.520031 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.520008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 21:48:08.520115 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.520034 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 21:48:08.520115 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.520009 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 21:48:08.521989 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.521966 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 21:48:08.524878 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.524858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 21:48:08.529739 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.529718 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.531206 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531192 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-grpc-tls\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531209 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-db\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531220 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531229 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531238 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531248 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-metrics-client-ca\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531257 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531265 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efeab228-3db1-470e-8936-02371d16d8d4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531273 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-kube-rbac-proxy\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531281 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efeab228-3db1-470e-8936-02371d16d8d4-config-out\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531289 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-tls-assets\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531296 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-web-config\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531305 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-metrics-client-certs\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531313 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-config\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531325 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531337 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531346 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhs4\" (UniqueName: \"kubernetes.io/projected/efeab228-3db1-470e-8936-02371d16d8d4-kube-api-access-lmhs4\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.531515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.531354 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efeab228-3db1-470e-8936-02371d16d8d4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:48:08.632807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.632807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-config-out\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.632807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.632807 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kl7x\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-kube-api-access-4kl7x\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-web-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.632987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.633429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.633306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734079 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734038 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734154 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734442 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.734867 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734887 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-config-out\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.734995 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kl7x\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-kube-api-access-4kl7x\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.735027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.735061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-web-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.735104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.735128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.735258 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.735237 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.737252 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.737225 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.738774 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.738531 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.739738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.738851 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.739738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.739738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.739738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739448 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414c67c3-e537-4d95-9633-86a491aef240-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.739738 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.739989 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.740011 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-web-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.740169 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-config\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.740175 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414c67c3-e537-4d95-9633-86a491aef240-config-out\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.740195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.740602 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.740365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.741505 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.741483 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.741935 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.741918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/414c67c3-e537-4d95-9633-86a491aef240-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.743314 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.743285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kl7x\" (UniqueName: \"kubernetes.io/projected/414c67c3-e537-4d95-9633-86a491aef240-kube-api-access-4kl7x\") pod \"prometheus-k8s-0\" (UID: \"414c67c3-e537-4d95-9633-86a491aef240\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.826642 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.826602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:08.977711 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:08.977679 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 21:48:08.980755 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:48:08.980729 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414c67c3_e537_4d95_9633_86a491aef240.slice/crio-e3c0d3b4960f67016bba716584bcbbfc9902f9e78b3bc7b7a1a378075cfb30a8 WatchSource:0}: Error finding container e3c0d3b4960f67016bba716584bcbbfc9902f9e78b3bc7b7a1a378075cfb30a8: Status 404 returned error can't find the container with id e3c0d3b4960f67016bba716584bcbbfc9902f9e78b3bc7b7a1a378075cfb30a8 Jun 11 21:48:09.137579 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.137541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:09.238204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.238116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:09.292206 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.292178 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:09.422215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.422190 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-94ddb" Jun 11 21:48:09.458850 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.458822 2581 generic.go:356] "Generic (PLEG): container finished" podID="414c67c3-e537-4d95-9633-86a491aef240" containerID="b5f40937d965b4ba42bc3a93a6b7a2fc2632b2eb47b33ed87571a8aa70b6f149" exitCode=0 Jun 11 21:48:09.459025 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.458907 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerDied","Data":"b5f40937d965b4ba42bc3a93a6b7a2fc2632b2eb47b33ed87571a8aa70b6f149"} Jun 11 21:48:09.459025 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:09.458987 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"e3c0d3b4960f67016bba716584bcbbfc9902f9e78b3bc7b7a1a378075cfb30a8"} Jun 11 21:48:10.396096 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.396062 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efeab228-3db1-470e-8936-02371d16d8d4" path="/var/lib/kubelet/pods/efeab228-3db1-470e-8936-02371d16d8d4/volumes" Jun 11 21:48:10.467493 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"207678174ebd5785b50c472a799ceb7617111d2474e262295174021ffe59e47c"} Jun 11 21:48:10.467636 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"13b02cd1ef8707d09bbddc6dcb571bebb50b4cb3da519ec95dfe64d28857c03a"} Jun 11 21:48:10.467636 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467576 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"7a2aaf7dc806377799b659b3cafc467277f8374560b7595ab5449c65d54f6594"} Jun 11 21:48:10.467636 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"8e169e222a78b447d7b0cc8e8b0bb6f1b6c1e50351e0d221c49c4440317693b3"} Jun 11 21:48:10.467805 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"f7eeeeeb88c0884ea081ad7e96fcf16ccba1de04d7cf49a15e71ca8aa541fda7"} Jun 11 21:48:10.467805 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.467708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"414c67c3-e537-4d95-9633-86a491aef240","Type":"ContainerStarted","Data":"87465d2b9bcc8e06918f7921877ccdc9ca9f73fa2a2f386ea80dba1a5a622662"} Jun 11 21:48:10.493396 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:10.493335 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.472107666 podStartE2EDuration="2.493313921s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.206255ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:48:10.490991452 +0000 UTC m=+298.558762587" watchObservedRunningTime="2026-06-11 21:48:10.493313921 +0000 UTC m=+298.561085058" Jun 11 21:48:11.791118 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:11.791079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:11.891617 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:11.891579 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:11.991946 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:11.991915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:12.352186 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:12.352159 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:48:12.353370 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:12.353351 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:48:12.355504 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:12.355485 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:48:12.547268 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:12.547233 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:12.648495 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:12.648409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:13.827208 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:13.827172 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:48:18.539978 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:18.539938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:22.375046 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:22.375003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:22.475581 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:22.475544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:22.526388 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:22.526324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:22.752046 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:22.752020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:22.852565 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:22.852522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:37.234931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:37.234898 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:39.231890 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:39.231857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:39.291679 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:39.291629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:51.015587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:51.015549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:48:51.116363 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:48:51.116336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:08.827517 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:08.827480 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:49:08.843537 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:08.843513 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:49:09.705293 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:09.705265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 21:49:17.923548 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:17.923507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:17.971174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:17.971139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.082756 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.082700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.127729 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.127692 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.221962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.221924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.322587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.322550 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.825112 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.825066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:20.870883 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:20.870845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:29.769280 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:29.769244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:29.816861 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:29.816836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:30.659229 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:30.659195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:30.709185 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:30.709149 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:30.857228 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:30.857193 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:30.902632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:30.902595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:37.758591 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:37.758549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:37.859486 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:37.859446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:49:37.910908 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:49:37.910864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:01.053004 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:01.052962 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:01.148898 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:01.148858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:22.609939 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:22.609849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:23.416990 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:23.416956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:26.041378 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:26.041334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:26.139885 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:26.139857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:27.156379 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:27.156341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:27.251003 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:27.250971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:27.717535 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:27.717498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:27.818716 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:27.818684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:31.027987 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:31.027952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:31.613706 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:31.613649 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:32.820037 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:32.820003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:32.875483 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:32.875440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:37.483691 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:37.483639 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:37.588004 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:37.587970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:38.829448 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:38.829421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:38.927447 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:38.927421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:39.631314 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:39.631281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:45.281760 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:45.281727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:45.382571 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:45.382540 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:50:47.249417 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:50:47.249382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:11.496679 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.496612 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:11.551216 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.551177 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr"] Jun 11 21:51:11.554514 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.554496 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.556697 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.556671 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:51:11.556811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.556678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 21:51:11.556811 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.556732 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 21:51:11.556915 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.556730 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qjx4v\"" Jun 11 21:51:11.556965 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.556879 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 21:51:11.557137 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.557114 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:51:11.568151 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.568109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr"] Jun 11 21:51:11.575844 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.575811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:11.641872 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.641835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgd8d\" (UniqueName: \"kubernetes.io/projected/b75158ca-d4a1-4e4a-aba1-fad094381215-kube-api-access-vgd8d\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.642042 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.641882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b75158ca-d4a1-4e4a-aba1-fad094381215-manager-config\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.642042 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.641950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.642042 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.641982 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.743344 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.743310 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b75158ca-d4a1-4e4a-aba1-fad094381215-manager-config\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.743533 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.743358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.743533 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.743377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.743533 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.743429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgd8d\" (UniqueName: \"kubernetes.io/projected/b75158ca-d4a1-4e4a-aba1-fad094381215-kube-api-access-vgd8d\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.744084 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.744060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b75158ca-d4a1-4e4a-aba1-fad094381215-manager-config\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.746113 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.746095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-metrics-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.746174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.746121 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75158ca-d4a1-4e4a-aba1-fad094381215-cert\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.751592 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.751549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgd8d\" (UniqueName: \"kubernetes.io/projected/b75158ca-d4a1-4e4a-aba1-fad094381215-kube-api-access-vgd8d\") pod \"lws-controller-manager-d4898ff9d-bd4zr\" (UID: \"b75158ca-d4a1-4e4a-aba1-fad094381215\") " pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.864302 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.864259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:11.993972 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.993939 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr"] Jun 11 21:51:11.997137 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:51:11.997109 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75158ca_d4a1_4e4a_aba1_fad094381215.slice/crio-529776bdaba2179ab8f94adf81ca284efe37ca8163aee4ca5ec39782e7024095 WatchSource:0}: Error finding container 529776bdaba2179ab8f94adf81ca284efe37ca8163aee4ca5ec39782e7024095: Status 404 returned error can't find the container with id 529776bdaba2179ab8f94adf81ca284efe37ca8163aee4ca5ec39782e7024095 Jun 11 21:51:11.999008 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:11.998992 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:51:12.156355 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:12.156317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" event={"ID":"b75158ca-d4a1-4e4a-aba1-fad094381215","Type":"ContainerStarted","Data":"529776bdaba2179ab8f94adf81ca284efe37ca8163aee4ca5ec39782e7024095"} Jun 11 21:51:14.431188 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:14.431143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:14.532052 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:14.531965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.044496 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.044464 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.170515 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.170472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" event={"ID":"b75158ca-d4a1-4e4a-aba1-fad094381215","Type":"ContainerStarted","Data":"4dadd5d9f1b82dc5052bb4b356f17969a53121b9abeb0bae759a5876a269e509"} Jun 11 21:51:15.170732 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.170601 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:15.188290 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.188230 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" podStartSLOduration=1.918207374 podStartE2EDuration="4.188214768s" totalImagesPullingTime="2.270007394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:15.187511761 +0000 UTC m=+483.255282895" watchObservedRunningTime="2026-06-11 21:51:15.188214768 +0000 UTC m=+483.255985904" Jun 11 21:51:15.253340 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.253305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.358271 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.358183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.382491 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.382459 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb"] Jun 11 21:51:15.388103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.388072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.390702 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.390678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:51:15.391103 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.391083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:51:15.391199 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.391126 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:51:15.391199 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.391139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cxzwm\"" Jun 11 21:51:15.391277 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.391198 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:51:15.406538 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.406516 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb"] Jun 11 21:51:15.473524 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.473491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.473931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.473532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.473931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.473550 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppc5\" (UniqueName: \"kubernetes.io/projected/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-kube-api-access-9ppc5\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.473931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.473686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.473931 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.473723 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.525918 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.525874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.574598 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.574570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.574739 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.574604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppc5\" (UniqueName: \"kubernetes.io/projected/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-kube-api-access-9ppc5\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.574739 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.574640 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.574739 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.574699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.574910 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.574770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.575079 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.575054 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-manifests\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.577155 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.577134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-tmp\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.577364 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.577346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.577407 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.577370 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.581864 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.581844 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppc5\" (UniqueName: \"kubernetes.io/projected/4c48c937-7c2b-4f59-bc58-8ed38ee12cfd-kube-api-access-9ppc5\") pod \"opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb\" (UID: \"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd\") " pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.626791 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.626721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.698694 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.698639 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:15.730623 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.730588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.824100 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.824066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.842756 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.842639 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb"] Jun 11 21:51:15.845510 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:51:15.845481 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c48c937_7c2b_4f59_bc58_8ed38ee12cfd.slice/crio-dad6ba054d9c4750c7c33cc80ad495e32e66d834171e2816a0dcde2612859743 WatchSource:0}: Error finding container dad6ba054d9c4750c7c33cc80ad495e32e66d834171e2816a0dcde2612859743: Status 404 returned error can't find the container with id dad6ba054d9c4750c7c33cc80ad495e32e66d834171e2816a0dcde2612859743 Jun 11 21:51:15.889112 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.889013 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:15.995994 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:15.995963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:16.175876 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:16.175795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" event={"ID":"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd","Type":"ContainerStarted","Data":"dad6ba054d9c4750c7c33cc80ad495e32e66d834171e2816a0dcde2612859743"} Jun 11 21:51:19.190551 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:19.190520 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" event={"ID":"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd","Type":"ContainerStarted","Data":"03905941b1f380fcbc8bb3062898ed327c511bf296591ffa2e2e3f50b2516ca3"} Jun 11 21:51:20.196253 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:20.196214 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c48c937-7c2b-4f59-bc58-8ed38ee12cfd" containerID="03905941b1f380fcbc8bb3062898ed327c511bf296591ffa2e2e3f50b2516ca3" exitCode=0 Jun 11 21:51:20.196736 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:20.196271 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" event={"ID":"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd","Type":"ContainerDied","Data":"03905941b1f380fcbc8bb3062898ed327c511bf296591ffa2e2e3f50b2516ca3"} Jun 11 21:51:21.202742 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:21.202700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" event={"ID":"4c48c937-7c2b-4f59-bc58-8ed38ee12cfd","Type":"ContainerStarted","Data":"5da37451bffbf358c42d8f9e6225622514603a6f42a9ee0f50ff0fcde7184559"} Jun 11 21:51:21.203204 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:21.202834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:21.221973 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:21.221923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" podStartSLOduration=2.116883402 podStartE2EDuration="6.221909023s" totalImagesPullingTime="3.170529496s" totalInitContainerRuntime="934.496125ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:21.220752403 +0000 UTC m=+489.288523542" watchObservedRunningTime="2026-06-11 21:51:21.221909023 +0000 UTC m=+489.289680157" Jun 11 21:51:26.178891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:26.178862 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4898ff9d-bd4zr" Jun 11 21:51:32.208193 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:32.208161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb" Jun 11 21:51:33.740433 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:33.740401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:33.844363 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:33.844316 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:33.985650 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:33.985618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.117551 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.117517 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.227814 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.227764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.413042 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.412961 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67b555db89-fcxst"] Jun 11 21:51:34.514007 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.513977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b555db89-fcxst"] Jun 11 21:51:34.514165 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.514080 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.516574 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.516543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 21:51:34.516803 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.516787 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 21:51:34.516910 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.516873 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wdbwf\"" Jun 11 21:51:34.565250 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.565207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.645142 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.645107 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tmp\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.645142 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.645142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tls-certs\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.645361 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.645189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5r5g\" (UniqueName: \"kubernetes.io/projected/501ffd46-36bc-4b61-972c-85f53b5ae3b1-kube-api-access-r5r5g\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.658138 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.658102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.745935 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.745912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tmp\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.746285 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.745944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tls-certs\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.746285 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.745973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5r5g\" (UniqueName: \"kubernetes.io/projected/501ffd46-36bc-4b61-972c-85f53b5ae3b1-kube-api-access-r5r5g\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.748319 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.748296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tmp\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.748431 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.748411 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ffd46-36bc-4b61-972c-85f53b5ae3b1-tls-certs\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.756381 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.756357 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5r5g\" (UniqueName: \"kubernetes.io/projected/501ffd46-36bc-4b61-972c-85f53b5ae3b1-kube-api-access-r5r5g\") pod \"kube-auth-proxy-67b555db89-fcxst\" (UID: \"501ffd46-36bc-4b61-972c-85f53b5ae3b1\") " pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.812828 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.812797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:34.824153 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.824133 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" Jun 11 21:51:34.957949 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.957839 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b555db89-fcxst"] Jun 11 21:51:34.962863 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:51:34.962832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501ffd46_36bc_4b61_972c_85f53b5ae3b1.slice/crio-531bfa2d84a0c2336de11e706406fb3408446d89272862e0b26102f5f8828960 WatchSource:0}: Error finding container 531bfa2d84a0c2336de11e706406fb3408446d89272862e0b26102f5f8828960: Status 404 returned error can't find the container with id 531bfa2d84a0c2336de11e706406fb3408446d89272862e0b26102f5f8828960 Jun 11 21:51:34.995674 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:34.995624 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:35.262756 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:35.262719 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" event={"ID":"501ffd46-36bc-4b61-972c-85f53b5ae3b1","Type":"ContainerStarted","Data":"531bfa2d84a0c2336de11e706406fb3408446d89272862e0b26102f5f8828960"} Jun 11 21:51:35.286624 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:35.286581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:35.387847 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:35.387817 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:35.441764 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:35.441735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:38.279613 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:38.279578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" event={"ID":"501ffd46-36bc-4b61-972c-85f53b5ae3b1","Type":"ContainerStarted","Data":"787b869426f5ffe22339d9606334b404381eba698e187554b365efc795c06ea7"} Jun 11 21:51:38.293484 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:38.293439 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67b555db89-fcxst" podStartSLOduration=1.493915095 podStartE2EDuration="4.293425859s" totalImagesPullingTime="2.799510764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:51:38.292245154 +0000 UTC m=+506.360016288" watchObservedRunningTime="2026-06-11 21:51:38.293425859 +0000 UTC m=+506.361196994" Jun 11 21:51:44.544782 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:44.544737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:44.984011 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:44.983909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:45.086116 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:45.086077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:45.252024 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:45.251991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:45.421899 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:45.421865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:46.233847 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:46.233813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:46.359965 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:46.359939 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:46.534040 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:46.534003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:46.637835 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:46.637806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:46.868129 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:46.868042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:47.307637 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:47.307600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:47.520089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:47.520053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:50.731339 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:50.731296 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:57.309067 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:57.309020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:57.407218 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:57.407183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:57.541089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:57.541055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:57.641418 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:57.641318 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:51:58.065987 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:51:58.065948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:00.951153 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:00.951119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:01.009262 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:01.009228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:01.225921 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:01.225833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:01.567125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:01.567096 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:01.662525 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:01.662491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:02.459027 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:02.458984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:13.713694 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:13.713634 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:35.350025 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:35.349984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:35.457328 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:35.457292 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:35.547021 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:35.546984 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:36.264604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:36.264560 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:36.465132 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:36.465098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:44.625133 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:44.625093 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:45.587598 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:45.587566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:46.777066 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:46.777024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:46.834215 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:46.834171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:55.563227 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:55.563188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:52:59.172424 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:52:59.172390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:00.718780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:00.718741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:01.336362 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:01.336332 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:02.572745 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:02.572711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:03.457579 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.457543 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c"] Jun 11 21:53:03.460839 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.460824 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:03.462700 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.462678 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:53:03.462959 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.462934 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:53:03.463046 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.462958 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6llsv\"" Jun 11 21:53:03.470566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.470545 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c"] Jun 11 21:53:03.592450 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.592405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfd8f\" (UniqueName: \"kubernetes.io/projected/e1f9417f-67bd-4f00-8faa-0d45033c9f41-kube-api-access-xfd8f\") pod \"authorino-operator-75cc8d5cb7-k6k9c\" (UID: \"e1f9417f-67bd-4f00-8faa-0d45033c9f41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:03.693522 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.693472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfd8f\" (UniqueName: \"kubernetes.io/projected/e1f9417f-67bd-4f00-8faa-0d45033c9f41-kube-api-access-xfd8f\") pod \"authorino-operator-75cc8d5cb7-k6k9c\" (UID: \"e1f9417f-67bd-4f00-8faa-0d45033c9f41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:03.700266 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.700246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfd8f\" (UniqueName: \"kubernetes.io/projected/e1f9417f-67bd-4f00-8faa-0d45033c9f41-kube-api-access-xfd8f\") pod \"authorino-operator-75cc8d5cb7-k6k9c\" (UID: \"e1f9417f-67bd-4f00-8faa-0d45033c9f41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:03.771631 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.771601 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:03.903063 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:03.903029 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c"] Jun 11 21:53:03.906427 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:53:03.906368 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f9417f_67bd_4f00_8faa_0d45033c9f41.slice/crio-f6715622cde8a8aab16e6fd8bcb2adff4c291e4f045dc55938f197e3baff72a2 WatchSource:0}: Error finding container f6715622cde8a8aab16e6fd8bcb2adff4c291e4f045dc55938f197e3baff72a2: Status 404 returned error can't find the container with id f6715622cde8a8aab16e6fd8bcb2adff4c291e4f045dc55938f197e3baff72a2 Jun 11 21:53:04.150427 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:04.150343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:04.249199 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:04.249162 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:04.638567 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:04.638531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" event={"ID":"e1f9417f-67bd-4f00-8faa-0d45033c9f41","Type":"ContainerStarted","Data":"f6715622cde8a8aab16e6fd8bcb2adff4c291e4f045dc55938f197e3baff72a2"} Jun 11 21:53:06.332114 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:06.332033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:06.649307 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:06.649208 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" event={"ID":"e1f9417f-67bd-4f00-8faa-0d45033c9f41","Type":"ContainerStarted","Data":"8e4089f4fc63b927acffa82d4c5debf7c0051078f3a14da88439c2e0e8af856c"} Jun 11 21:53:06.649307 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:06.649279 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:06.667857 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:06.667807 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" podStartSLOduration=1.559341476 podStartE2EDuration="3.66778958s" totalImagesPullingTime="2.108448104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:53:06.667325065 +0000 UTC m=+594.735096201" watchObservedRunningTime="2026-06-11 21:53:06.66778958 +0000 UTC m=+594.735560719" Jun 11 21:53:08.193101 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:08.193067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:09.943710 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:09.943677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:09.996518 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:09.996494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:11.124208 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:11.124174 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:11.218528 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:11.218491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:12.377954 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:12.377928 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:53:12.378412 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:12.378132 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:53:15.221166 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:15.221129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:15.282632 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:15.282600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:17.655958 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:17.655928 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-k6k9c" Jun 11 21:53:19.157409 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:19.157372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:19.257432 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:19.257397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:21.664064 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:21.663960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:21.760521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:21.760487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:26.360117 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:26.360081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:26.426547 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:26.426511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:26.525064 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:26.525024 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:26.627858 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:26.627755 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:26.728400 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:26.728344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:30.156174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:30.156137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:30.206194 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:30.206159 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:37.538349 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:37.538301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:37.594107 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:37.594066 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:38.832989 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:38.832949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:38.932071 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:38.932035 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:41.271508 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:41.271470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:41.372335 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:41.372300 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:46.026478 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:46.026443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:46.128499 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:46.128459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:50.026061 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:50.026019 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:53:50.126013 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:53:50.125978 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:00.231901 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:00.231856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:00.330092 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:00.330055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:00.428748 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:00.428709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:00.477780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:00.477739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:02.016530 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:02.016486 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:02.065929 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:02.065897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:03.257951 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:03.257914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:03.352462 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:03.352430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:06.469059 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:06.469018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:06.631426 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:06.631389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:07.596890 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:07.596850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:07.688038 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:07.688001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:07.788743 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:07.788703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:08.382472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.382437 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:08.385871 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.385856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:08.387700 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.387681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sq87d\"" Jun 11 21:54:08.396532 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.396509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:08.403071 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.403045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:08.469006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.468957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkkv\" (UniqueName: \"kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv\") pod \"authorino-58cd955675-kjg65\" (UID: \"e09879a1-5eae-43b8-a093-e686ff812f8a\") " pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:08.483479 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.483452 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:08.570125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.570093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkkv\" (UniqueName: \"kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv\") pod \"authorino-58cd955675-kjg65\" (UID: \"e09879a1-5eae-43b8-a093-e686ff812f8a\") " pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:08.577149 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.577120 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkkv\" (UniqueName: \"kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv\") pod \"authorino-58cd955675-kjg65\" (UID: \"e09879a1-5eae-43b8-a093-e686ff812f8a\") " pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:08.709151 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.709077 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:08.732810 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.732783 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:54:08.736206 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.736187 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:54:08.741585 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.741556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:54:08.772455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.772421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w94z\" (UniqueName: \"kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z\") pod \"authorino-75d556bd77-bvld4\" (UID: \"fe1f5502-8966-4ff8-9f24-5ff20fa48e16\") " pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:54:08.839194 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.839163 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:08.843867 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:54:08.843840 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode09879a1_5eae_43b8_a093_e686ff812f8a.slice/crio-2f16ea5ad502c6b6f8b709abfa60ba6e6769e264da5b7eb286ef8e8415a0f3ea WatchSource:0}: Error finding container 2f16ea5ad502c6b6f8b709abfa60ba6e6769e264da5b7eb286ef8e8415a0f3ea: Status 404 returned error can't find the container with id 2f16ea5ad502c6b6f8b709abfa60ba6e6769e264da5b7eb286ef8e8415a0f3ea Jun 11 21:54:08.872920 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.872888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w94z\" (UniqueName: \"kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z\") pod \"authorino-75d556bd77-bvld4\" (UID: \"fe1f5502-8966-4ff8-9f24-5ff20fa48e16\") " pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:54:08.880270 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.880246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w94z\" (UniqueName: \"kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z\") pod \"authorino-75d556bd77-bvld4\" (UID: \"fe1f5502-8966-4ff8-9f24-5ff20fa48e16\") " pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:54:08.910603 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:08.910574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjg65" event={"ID":"e09879a1-5eae-43b8-a093-e686ff812f8a","Type":"ContainerStarted","Data":"2f16ea5ad502c6b6f8b709abfa60ba6e6769e264da5b7eb286ef8e8415a0f3ea"} Jun 11 21:54:09.046482 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:09.046453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:54:09.176836 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:09.176806 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:54:09.181110 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:54:09.181084 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe1f5502_8966_4ff8_9f24_5ff20fa48e16.slice/crio-3583b03d559692ecfa854ebeb0c215135160526647d445782ce25fb45b68415e WatchSource:0}: Error finding container 3583b03d559692ecfa854ebeb0c215135160526647d445782ce25fb45b68415e: Status 404 returned error can't find the container with id 3583b03d559692ecfa854ebeb0c215135160526647d445782ce25fb45b68415e Jun 11 21:54:09.924604 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:09.924484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvld4" event={"ID":"fe1f5502-8966-4ff8-9f24-5ff20fa48e16","Type":"ContainerStarted","Data":"3583b03d559692ecfa854ebeb0c215135160526647d445782ce25fb45b68415e"} Jun 11 21:54:12.940709 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:12.940644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvld4" event={"ID":"fe1f5502-8966-4ff8-9f24-5ff20fa48e16","Type":"ContainerStarted","Data":"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6"} Jun 11 21:54:12.942015 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:12.941984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjg65" event={"ID":"e09879a1-5eae-43b8-a093-e686ff812f8a","Type":"ContainerStarted","Data":"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5"} Jun 11 21:54:12.957292 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:12.957250 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bvld4" podStartSLOduration=1.798365744 podStartE2EDuration="4.957235474s" totalImagesPullingTime="3.15886973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:54:12.956044926 +0000 UTC m=+661.023816062" watchObservedRunningTime="2026-06-11 21:54:12.957235474 +0000 UTC m=+661.025006612" Jun 11 21:54:12.969361 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:12.969314 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kjg65" podStartSLOduration=1.485904089 podStartE2EDuration="4.969298609s" totalImagesPullingTime="3.48339452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:54:12.96854713 +0000 UTC m=+661.036318270" watchObservedRunningTime="2026-06-11 21:54:12.969298609 +0000 UTC m=+661.037069744" Jun 11 21:54:12.991546 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:12.991513 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:14.952157 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:14.952105 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kjg65" podUID="e09879a1-5eae-43b8-a093-e686ff812f8a" containerName="authorino" containerID="cri-o://e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5" gracePeriod=30 Jun 11 21:54:15.204510 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.204453 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:15.226484 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.226451 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdkkv\" (UniqueName: \"kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv\") pod \"e09879a1-5eae-43b8-a093-e686ff812f8a\" (UID: \"e09879a1-5eae-43b8-a093-e686ff812f8a\") " Jun 11 21:54:15.228828 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.228795 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv" (OuterVolumeSpecName: "kube-api-access-wdkkv") pod "e09879a1-5eae-43b8-a093-e686ff812f8a" (UID: "e09879a1-5eae-43b8-a093-e686ff812f8a"). InnerVolumeSpecName "kube-api-access-wdkkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:54:15.327149 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.327119 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdkkv\" (UniqueName: \"kubernetes.io/projected/e09879a1-5eae-43b8-a093-e686ff812f8a-kube-api-access-wdkkv\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:54:15.957614 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.957576 2581 generic.go:356] "Generic (PLEG): container finished" podID="e09879a1-5eae-43b8-a093-e686ff812f8a" containerID="e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5" exitCode=0 Jun 11 21:54:15.957614 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.957619 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kjg65" Jun 11 21:54:15.958097 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.957681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjg65" event={"ID":"e09879a1-5eae-43b8-a093-e686ff812f8a","Type":"ContainerDied","Data":"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5"} Jun 11 21:54:15.958097 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.957722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kjg65" event={"ID":"e09879a1-5eae-43b8-a093-e686ff812f8a","Type":"ContainerDied","Data":"2f16ea5ad502c6b6f8b709abfa60ba6e6769e264da5b7eb286ef8e8415a0f3ea"} Jun 11 21:54:15.958097 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.957740 2581 scope.go:117] "RemoveContainer" containerID="e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5" Jun 11 21:54:15.966577 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.966561 2581 scope.go:117] "RemoveContainer" containerID="e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5" Jun 11 21:54:15.966863 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:54:15.966846 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5\": container with ID starting with e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5 not found: ID does not exist" containerID="e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5" Jun 11 21:54:15.966932 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.966869 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5"} err="failed to get container status \"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5\": rpc error: code = NotFound desc = could not find container \"e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5\": container with ID starting with e71197595ed95f5165fd79b4eaf8a8b5d44a99a1af2b4f4ecbd56f191927bae5 not found: ID does not exist" Jun 11 21:54:15.975937 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.975913 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:15.978903 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:15.978885 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kjg65"] Jun 11 21:54:16.395713 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:16.395649 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e09879a1-5eae-43b8-a093-e686ff812f8a" path="/var/lib/kubelet/pods/e09879a1-5eae-43b8-a093-e686ff812f8a/volumes" Jun 11 21:54:23.729704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:23.729644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:26.132241 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:26.132200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:34.013097 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:34.013057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:34.102568 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:34.102533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:34.262295 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:34.262260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:42.608793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:42.608738 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:57.776992 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:57.776957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:57.876240 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:57.876208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:54:58.177633 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.177556 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:54:58.177898 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.177885 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e09879a1-5eae-43b8-a093-e686ff812f8a" containerName="authorino" Jun 11 21:54:58.177941 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.177902 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e09879a1-5eae-43b8-a093-e686ff812f8a" containerName="authorino" Jun 11 21:54:58.177979 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.177972 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e09879a1-5eae-43b8-a093-e686ff812f8a" containerName="authorino" Jun 11 21:54:58.180276 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.180256 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:54:58.182059 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.182030 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 21:54:58.182162 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.182096 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 21:54:58.182162 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.182120 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ll2zq\"" Jun 11 21:54:58.182397 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.182382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 21:54:58.189864 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.189843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:54:58.192125 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.192105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzmpv\" (UniqueName: \"kubernetes.io/projected/c4428a0e-128c-4a20-9898-20268df5a4dd-kube-api-access-mzmpv\") pod \"maas-keycloak-0\" (UID: \"c4428a0e-128c-4a20-9898-20268df5a4dd\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:54:58.292737 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.292702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzmpv\" (UniqueName: \"kubernetes.io/projected/c4428a0e-128c-4a20-9898-20268df5a4dd-kube-api-access-mzmpv\") pod \"maas-keycloak-0\" (UID: \"c4428a0e-128c-4a20-9898-20268df5a4dd\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:54:58.301102 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.301071 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzmpv\" (UniqueName: \"kubernetes.io/projected/c4428a0e-128c-4a20-9898-20268df5a4dd-kube-api-access-mzmpv\") pod \"maas-keycloak-0\" (UID: \"c4428a0e-128c-4a20-9898-20268df5a4dd\") " pod="keycloak-system/maas-keycloak-0" Jun 11 21:54:58.490521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.490437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 21:54:58.621679 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:58.621637 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 21:54:58.624131 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:54:58.624107 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4428a0e_128c_4a20_9898_20268df5a4dd.slice/crio-94a77aecb25d0c24151a10d551621baba6d79f78d44cf06e82448e30eaae6c83 WatchSource:0}: Error finding container 94a77aecb25d0c24151a10d551621baba6d79f78d44cf06e82448e30eaae6c83: Status 404 returned error can't find the container with id 94a77aecb25d0c24151a10d551621baba6d79f78d44cf06e82448e30eaae6c83 Jun 11 21:54:59.151689 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:54:59.151632 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4428a0e-128c-4a20-9898-20268df5a4dd","Type":"ContainerStarted","Data":"94a77aecb25d0c24151a10d551621baba6d79f78d44cf06e82448e30eaae6c83"} Jun 11 21:55:03.173421 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:03.173387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4428a0e-128c-4a20-9898-20268df5a4dd","Type":"ContainerStarted","Data":"b2cd06492843f76258bbf4a415aa2222a104213aeb2ec57653a6bfc17b3fe432"} Jun 11 21:55:03.191970 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:03.191922 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.832433229 podStartE2EDuration="5.19190227s" totalImagesPullingTime="4.359469041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:55:03.191196298 +0000 UTC m=+711.258967438" watchObservedRunningTime="2026-06-11 21:55:03.19190227 +0000 UTC m=+711.259673401" Jun 11 21:55:03.490924 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:03.490877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 21:55:03.492297 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:03.492259 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:04.491106 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:04.491052 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:05.491754 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:05.491702 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:06.491430 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:06.491384 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:07.491868 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:07.491811 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:08.491422 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:08.491382 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:55:08.492850 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:08.492820 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:09.491289 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:09.491232 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:10.491607 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:10.491554 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:11.491044 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:11.490986 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:12.490949 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:12.490894 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:13.491269 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:13.491217 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:14.491176 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:14.491119 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:15.491265 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:15.491211 2581 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.26:9000/health/started\": dial tcp 10.134.0.26:9000: connect: connection refused" Jun 11 21:55:16.597320 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:16.597287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 21:55:16.616184 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:16.616135 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c4428a0e-128c-4a20-9898-20268df5a4dd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:55:22.260379 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:22.260336 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:26.603003 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:26.602968 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 21:55:27.249236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.249198 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:27.367457 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.367423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:27.480567 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.480536 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pj7ch"] Jun 11 21:55:27.482909 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.482895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:27.490246 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.490224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pj7ch"] Jun 11 21:55:27.577629 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.577539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qxzl\" (UniqueName: \"kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl\") pod \"authorino-5d4b67c446-pj7ch\" (UID: \"8f3b322b-b7f8-4cb0-8f85-2688b8323e1a\") " pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:27.657086 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.657051 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pj7ch"] Jun 11 21:55:27.657457 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:27.657299 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9qxzl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pj7ch" podUID="8f3b322b-b7f8-4cb0-8f85-2688b8323e1a" Jun 11 21:55:27.677288 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.677258 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-4j9x9"] Jun 11 21:55:27.678068 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.678041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qxzl\" (UniqueName: \"kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl\") pod \"authorino-5d4b67c446-pj7ch\" (UID: \"8f3b322b-b7f8-4cb0-8f85-2688b8323e1a\") " pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:27.679756 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.679742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.681464 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.681442 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 21:55:27.688556 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.688530 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-4j9x9"] Jun 11 21:55:27.690779 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.690749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qxzl\" (UniqueName: \"kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl\") pod \"authorino-5d4b67c446-pj7ch\" (UID: \"8f3b322b-b7f8-4cb0-8f85-2688b8323e1a\") " pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:27.726036 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.725985 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4j9x9"] Jun 11 21:55:27.726638 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:27.726609 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-j5f8m tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-4j9x9" podUID="cf9b099b-9dbd-4b80-b753-4fe2b031ef38" Jun 11 21:55:27.748061 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.748032 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c4fc7c657-t52xl"] Jun 11 21:55:27.750886 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.750870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.758050 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.758024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4fc7c657-t52xl"] Jun 11 21:55:27.778833 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.778804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.778983 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.778843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5f8m\" (UniqueName: \"kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.879780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.879698 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.879780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.879734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzjwr\" (UniqueName: \"kubernetes.io/projected/000cf964-1946-4b9d-bda4-5be8467d67c6-kube-api-access-wzjwr\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.879780 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.879761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5f8m\" (UniqueName: \"kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.880045 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.879826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/000cf964-1946-4b9d-bda4-5be8467d67c6-tls-cert\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.882194 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.882174 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.887011 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.886992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5f8m\" (UniqueName: \"kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m\") pod \"authorino-76877994-4j9x9\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:27.980899 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.980861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/000cf964-1946-4b9d-bda4-5be8467d67c6-tls-cert\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.981080 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.980958 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzjwr\" (UniqueName: \"kubernetes.io/projected/000cf964-1946-4b9d-bda4-5be8467d67c6-kube-api-access-wzjwr\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.983443 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.983423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/000cf964-1946-4b9d-bda4-5be8467d67c6-tls-cert\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:27.988217 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:27.988193 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzjwr\" (UniqueName: \"kubernetes.io/projected/000cf964-1946-4b9d-bda4-5be8467d67c6-kube-api-access-wzjwr\") pod \"authorino-6c4fc7c657-t52xl\" (UID: \"000cf964-1946-4b9d-bda4-5be8467d67c6\") " pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:28.060472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.060440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4fc7c657-t52xl" Jun 11 21:55:28.192472 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.192306 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4fc7c657-t52xl"] Jun 11 21:55:28.195255 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:55:28.195233 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod000cf964_1946_4b9d_bda4_5be8467d67c6.slice/crio-52bc74a817bb3da4d64de70e890f83f52107cd7218c21274484488629c19ea18 WatchSource:0}: Error finding container 52bc74a817bb3da4d64de70e890f83f52107cd7218c21274484488629c19ea18: Status 404 returned error can't find the container with id 52bc74a817bb3da4d64de70e890f83f52107cd7218c21274484488629c19ea18 Jun 11 21:55:28.312910 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.312879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:28.312910 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.312889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4fc7c657-t52xl" event={"ID":"000cf964-1946-4b9d-bda4-5be8467d67c6","Type":"ContainerStarted","Data":"52bc74a817bb3da4d64de70e890f83f52107cd7218c21274484488629c19ea18"} Jun 11 21:55:28.313102 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.313029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:28.319841 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.319820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:28.322557 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.322539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:28.486135 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.486044 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qxzl\" (UniqueName: \"kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl\") pod \"8f3b322b-b7f8-4cb0-8f85-2688b8323e1a\" (UID: \"8f3b322b-b7f8-4cb0-8f85-2688b8323e1a\") " Jun 11 21:55:28.486135 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.486082 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert\") pod \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " Jun 11 21:55:28.486135 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.486123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5f8m\" (UniqueName: \"kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m\") pod \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\" (UID: \"cf9b099b-9dbd-4b80-b753-4fe2b031ef38\") " Jun 11 21:55:28.488247 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.488219 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cf9b099b-9dbd-4b80-b753-4fe2b031ef38" (UID: "cf9b099b-9dbd-4b80-b753-4fe2b031ef38"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:55:28.488349 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.488323 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m" (OuterVolumeSpecName: "kube-api-access-j5f8m") pod "cf9b099b-9dbd-4b80-b753-4fe2b031ef38" (UID: "cf9b099b-9dbd-4b80-b753-4fe2b031ef38"). InnerVolumeSpecName "kube-api-access-j5f8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:55:28.488400 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.488363 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl" (OuterVolumeSpecName: "kube-api-access-9qxzl") pod "8f3b322b-b7f8-4cb0-8f85-2688b8323e1a" (UID: "8f3b322b-b7f8-4cb0-8f85-2688b8323e1a"). InnerVolumeSpecName "kube-api-access-9qxzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:55:28.587302 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.587274 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qxzl\" (UniqueName: \"kubernetes.io/projected/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a-kube-api-access-9qxzl\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:55:28.587398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.587307 2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-tls-cert\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:55:28.587398 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:28.587321 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5f8m\" (UniqueName: \"kubernetes.io/projected/cf9b099b-9dbd-4b80-b753-4fe2b031ef38-kube-api-access-j5f8m\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:55:29.318882 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.318856 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pj7ch" Jun 11 21:55:29.319340 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.318889 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4fc7c657-t52xl" event={"ID":"000cf964-1946-4b9d-bda4-5be8467d67c6","Type":"ContainerStarted","Data":"0da3705a708329923f02e775a86be7e7a9a35c438fff463d2a96396787161211"} Jun 11 21:55:29.319340 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.319102 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-4j9x9" Jun 11 21:55:29.333552 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.333509 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c4fc7c657-t52xl" podStartSLOduration=2.005865611 podStartE2EDuration="2.333495194s" totalImagesPullingTime="327.629583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:55:29.332401419 +0000 UTC m=+737.400172555" watchObservedRunningTime="2026-06-11 21:55:29.333495194 +0000 UTC m=+737.401266369" Jun 11 21:55:29.357024 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.356998 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:55:29.357177 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.357154 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bvld4" podUID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" containerName="authorino" containerID="cri-o://339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6" gracePeriod=30 Jun 11 21:55:29.362282 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.362221 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-4j9x9"] Jun 11 21:55:29.369259 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.369233 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-4j9x9"] Jun 11 21:55:29.389179 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.389150 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pj7ch"] Jun 11 21:55:29.391303 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.391276 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pj7ch"] Jun 11 21:55:29.598449 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.598424 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:55:29.696949 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.696916 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w94z\" (UniqueName: \"kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z\") pod \"fe1f5502-8966-4ff8-9f24-5ff20fa48e16\" (UID: \"fe1f5502-8966-4ff8-9f24-5ff20fa48e16\") " Jun 11 21:55:29.699012 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.698981 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z" (OuterVolumeSpecName: "kube-api-access-9w94z") pod "fe1f5502-8966-4ff8-9f24-5ff20fa48e16" (UID: "fe1f5502-8966-4ff8-9f24-5ff20fa48e16"). InnerVolumeSpecName "kube-api-access-9w94z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:55:29.797746 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:29.797715 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w94z\" (UniqueName: \"kubernetes.io/projected/fe1f5502-8966-4ff8-9f24-5ff20fa48e16-kube-api-access-9w94z\") on node \"ip-10-0-141-164.ec2.internal\" DevicePath \"\"" Jun 11 21:55:30.324312 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.324275 2581 generic.go:356] "Generic (PLEG): container finished" podID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" containerID="339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6" exitCode=0 Jun 11 21:55:30.324775 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.324317 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvld4" Jun 11 21:55:30.324775 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.324363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvld4" event={"ID":"fe1f5502-8966-4ff8-9f24-5ff20fa48e16","Type":"ContainerDied","Data":"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6"} Jun 11 21:55:30.324775 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.324404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvld4" event={"ID":"fe1f5502-8966-4ff8-9f24-5ff20fa48e16","Type":"ContainerDied","Data":"3583b03d559692ecfa854ebeb0c215135160526647d445782ce25fb45b68415e"} Jun 11 21:55:30.324775 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.324425 2581 scope.go:117] "RemoveContainer" containerID="339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6" Jun 11 21:55:30.333395 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.333380 2581 scope.go:117] "RemoveContainer" containerID="339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6" Jun 11 21:55:30.333677 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:30.333636 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6\": container with ID starting with 339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6 not found: ID does not exist" containerID="339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6" Jun 11 21:55:30.333746 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.333677 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6"} err="failed to get container status \"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6\": rpc error: code = NotFound desc = could not find container \"339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6\": container with ID starting with 339b3e7aad076cf3c30c0e5ede24026921921286b51ca91154e80d4f46691ef6 not found: ID does not exist" Jun 11 21:55:30.343236 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.343210 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:55:30.347561 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.347541 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvld4"] Jun 11 21:55:30.395210 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.395177 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f3b322b-b7f8-4cb0-8f85-2688b8323e1a" path="/var/lib/kubelet/pods/8f3b322b-b7f8-4cb0-8f85-2688b8323e1a/volumes" Jun 11 21:55:30.395427 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.395415 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9b099b-9dbd-4b80-b753-4fe2b031ef38" path="/var/lib/kubelet/pods/cf9b099b-9dbd-4b80-b753-4fe2b031ef38/volumes" Jun 11 21:55:30.395616 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:30.395605 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" path="/var/lib/kubelet/pods/fe1f5502-8966-4ff8-9f24-5ff20fa48e16/volumes" Jun 11 21:55:32.828393 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.828358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:32.836999 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.836974 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57f6c5ffb7-7sl5x"] Jun 11 21:55:32.837296 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.837285 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" containerName="authorino" Jun 11 21:55:32.837351 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.837298 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" containerName="authorino" Jun 11 21:55:32.837387 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.837358 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1f5502-8966-4ff8-9f24-5ff20fa48e16" containerName="authorino" Jun 11 21:55:32.840401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.840383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:32.842400 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.842379 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 21:55:32.842506 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.842403 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-blc2t\"" Jun 11 21:55:32.842809 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.842795 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 21:55:32.849095 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.849068 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f6c5ffb7-7sl5x"] Jun 11 21:55:32.917209 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.917176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:32.928367 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.928339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:32.928502 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:32.928402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcbct\" (UniqueName: \"kubernetes.io/projected/ce9403e1-4ffb-428d-86e9-253960b8aa61-kube-api-access-wcbct\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.009509 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.009467 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:33.012911 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.012890 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75fd78dd4b-g9gqt"] Jun 11 21:55:33.015275 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.015259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.023887 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.023862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75fd78dd4b-g9gqt"] Jun 11 21:55:33.029307 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.029285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcbct\" (UniqueName: \"kubernetes.io/projected/ce9403e1-4ffb-428d-86e9-253960b8aa61-kube-api-access-wcbct\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.029426 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.029342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-webhook-cert\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.029478 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.029440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhztg\" (UniqueName: \"kubernetes.io/projected/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-kube-api-access-nhztg\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.029527 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.029474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.029611 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:33.029598 2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 21:55:33.029724 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:33.029679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert podName:ce9403e1-4ffb-428d-86e9-253960b8aa61 nodeName:}" failed. No retries permitted until 2026-06-11 21:55:33.529639342 +0000 UTC m=+741.597410458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert") pod "maas-controller-57f6c5ffb7-7sl5x" (UID: "ce9403e1-4ffb-428d-86e9-253960b8aa61") : secret "maas-controller-webhook-cert" not found Jun 11 21:55:33.038075 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.038041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcbct\" (UniqueName: \"kubernetes.io/projected/ce9403e1-4ffb-428d-86e9-253960b8aa61-kube-api-access-wcbct\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.130110 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.130019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-webhook-cert\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.130110 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.130085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhztg\" (UniqueName: \"kubernetes.io/projected/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-kube-api-access-nhztg\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.132582 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.132561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-webhook-cert\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.137548 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.137526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhztg\" (UniqueName: \"kubernetes.io/projected/dfb36e0f-7c7e-48b8-8415-57f046dae3d4-kube-api-access-nhztg\") pod \"maas-controller-75fd78dd4b-g9gqt\" (UID: \"dfb36e0f-7c7e-48b8-8415-57f046dae3d4\") " pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.159061 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.159033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:55:33.325417 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.325383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:33.455305 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.455155 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75fd78dd4b-g9gqt"] Jun 11 21:55:33.457757 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:55:33.457734 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb36e0f_7c7e_48b8_8415_57f046dae3d4.slice/crio-c75343d04f25521b9bb24eed9c1ab7939c4c13d7384513ce3093cccf3c166c79 WatchSource:0}: Error finding container c75343d04f25521b9bb24eed9c1ab7939c4c13d7384513ce3093cccf3c166c79: Status 404 returned error can't find the container with id c75343d04f25521b9bb24eed9c1ab7939c4c13d7384513ce3093cccf3c166c79 Jun 11 21:55:33.533404 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.533372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.535877 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.535852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce9403e1-4ffb-428d-86e9-253960b8aa61-webhook-cert\") pod \"maas-controller-57f6c5ffb7-7sl5x\" (UID: \"ce9403e1-4ffb-428d-86e9-253960b8aa61\") " pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.751757 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.751731 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:33.886029 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:33.886003 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f6c5ffb7-7sl5x"] Jun 11 21:55:33.888611 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:55:33.888585 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9403e1_4ffb_428d_86e9_253960b8aa61.slice/crio-a543f945aa617a81086f6bd66aa104c2651dd58608c04fb473ca5b3dab1793af WatchSource:0}: Error finding container a543f945aa617a81086f6bd66aa104c2651dd58608c04fb473ca5b3dab1793af: Status 404 returned error can't find the container with id a543f945aa617a81086f6bd66aa104c2651dd58608c04fb473ca5b3dab1793af Jun 11 21:55:34.345806 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:34.345760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerStarted","Data":"c75343d04f25521b9bb24eed9c1ab7939c4c13d7384513ce3093cccf3c166c79"} Jun 11 21:55:34.347026 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:34.347000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerStarted","Data":"a543f945aa617a81086f6bd66aa104c2651dd58608c04fb473ca5b3dab1793af"} Jun 11 21:55:36.356935 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.356900 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce9403e1-4ffb-428d-86e9-253960b8aa61" containerID="76fa7e3a320a3cf58f3b7ddc46bf1bac4439d95050b882e0e22640578f1fab13" exitCode=1 Jun 11 21:55:36.357425 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.356997 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerDied","Data":"76fa7e3a320a3cf58f3b7ddc46bf1bac4439d95050b882e0e22640578f1fab13"} Jun 11 21:55:36.357425 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.357203 2581 scope.go:117] "RemoveContainer" containerID="76fa7e3a320a3cf58f3b7ddc46bf1bac4439d95050b882e0e22640578f1fab13" Jun 11 21:55:36.358610 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.358589 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" containerID="c00ec8ff030e5571acef6eaac49b72fb55c2bf38e44e2c7fbd4a8babbad8049c" exitCode=1 Jun 11 21:55:36.358721 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.358624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerDied","Data":"c00ec8ff030e5571acef6eaac49b72fb55c2bf38e44e2c7fbd4a8babbad8049c"} Jun 11 21:55:36.358918 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:36.358901 2581 scope.go:117] "RemoveContainer" containerID="c00ec8ff030e5571acef6eaac49b72fb55c2bf38e44e2c7fbd4a8babbad8049c" Jun 11 21:55:37.365396 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.365364 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" exitCode=1 Jun 11 21:55:37.365891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.365447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerDied","Data":"f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc"} Jun 11 21:55:37.365891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.365510 2581 scope.go:117] "RemoveContainer" containerID="c00ec8ff030e5571acef6eaac49b72fb55c2bf38e44e2c7fbd4a8babbad8049c" Jun 11 21:55:37.365891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.365771 2581 scope.go:117] "RemoveContainer" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" Jun 11 21:55:37.366023 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:37.365978 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:55:37.367368 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.367348 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce9403e1-4ffb-428d-86e9-253960b8aa61" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" exitCode=1 Jun 11 21:55:37.367462 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.367405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerDied","Data":"e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011"} Jun 11 21:55:37.367596 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.367584 2581 scope.go:117] "RemoveContainer" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" Jun 11 21:55:37.367781 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:37.367764 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:55:37.376546 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:37.376520 2581 scope.go:117] "RemoveContainer" containerID="76fa7e3a320a3cf58f3b7ddc46bf1bac4439d95050b882e0e22640578f1fab13" Jun 11 21:55:38.373587 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:38.373561 2581 scope.go:117] "RemoveContainer" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" Jun 11 21:55:38.374043 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:38.373763 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:55:38.374894 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:38.374878 2581 scope.go:117] "RemoveContainer" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" Jun 11 21:55:38.375019 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:38.375003 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:55:43.325766 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:43.325729 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:43.326196 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:43.326139 2581 scope.go:117] "RemoveContainer" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" Jun 11 21:55:43.326319 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:43.326299 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:55:43.752374 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:43.752332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:43.752806 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:43.752792 2581 scope.go:117] "RemoveContainer" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" Jun 11 21:55:43.752978 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:43.752960 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:55:53.325878 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:53.325826 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:55:53.326299 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:53.326204 2581 scope.go:117] "RemoveContainer" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" Jun 11 21:55:53.752321 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:53.752302 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:55:53.752650 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:53.752637 2581 scope.go:117] "RemoveContainer" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" Jun 11 21:55:54.445977 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.445897 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" exitCode=1 Jun 11 21:55:54.446383 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.445970 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerDied","Data":"c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a"} Jun 11 21:55:54.446383 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.446024 2581 scope.go:117] "RemoveContainer" containerID="f254b2097f169136008f29ed2b8a18a8426e90f0c300e5f046fe99ee018217bc" Jun 11 21:55:54.446494 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.446416 2581 scope.go:117] "RemoveContainer" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" Jun 11 21:55:54.446637 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:54.446610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:55:54.447872 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.447852 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce9403e1-4ffb-428d-86e9-253960b8aa61" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" exitCode=1 Jun 11 21:55:54.447976 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.447928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerDied","Data":"f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5"} Jun 11 21:55:54.448200 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.448187 2581 scope.go:117] "RemoveContainer" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" Jun 11 21:55:54.448340 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:55:54.448324 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:55:54.459170 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:55:54.459156 2581 scope.go:117] "RemoveContainer" containerID="e5d4b1df2aca122722fa2d82f1b1172609b4c604c5421e909a1f6681dbc1b011" Jun 11 21:56:03.325908 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:03.325859 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:56:03.326327 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:03.326288 2581 scope.go:117] "RemoveContainer" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" Jun 11 21:56:03.326488 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:03.326470 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:56:03.751946 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:03.751920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:56:03.752265 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:03.752252 2581 scope.go:117] "RemoveContainer" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" Jun 11 21:56:03.752419 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:03.752399 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:56:13.326026 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:13.325990 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:56:13.326446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:13.326411 2581 scope.go:117] "RemoveContainer" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" Jun 11 21:56:13.326609 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:13.326589 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:56:13.752142 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:13.752111 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:56:13.752482 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:13.752470 2581 scope.go:117] "RemoveContainer" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" Jun 11 21:56:13.752683 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:13.752643 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:56:25.390542 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:25.390465 2581 scope.go:117] "RemoveContainer" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" Jun 11 21:56:25.390963 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:25.390807 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:56:26.599503 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:26.599466 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce9403e1-4ffb-428d-86e9-253960b8aa61" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" exitCode=1 Jun 11 21:56:26.599948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:26.599535 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerDied","Data":"cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e"} Jun 11 21:56:26.599948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:26.599600 2581 scope.go:117] "RemoveContainer" containerID="f8c2969e0619698d7f415441e7fff6464104854cf3c4fcbc206beaa1fc9eabe5" Jun 11 21:56:26.599948 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:26.599934 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:56:26.600530 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:26.600167 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:56:28.389988 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:28.389952 2581 scope.go:117] "RemoveContainer" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" Jun 11 21:56:29.622626 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:29.622592 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" exitCode=1 Jun 11 21:56:29.623056 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:29.622688 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerDied","Data":"a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d"} Jun 11 21:56:29.623056 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:29.622769 2581 scope.go:117] "RemoveContainer" containerID="c30c1fbed1cdd4873fc4faf9c7a29bd46ccf6b4ffd8a1ea9bf80f42ddeca7c7a" Jun 11 21:56:29.623161 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:29.623074 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:56:29.623249 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:29.623229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:56:33.325674 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.325634 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:56:33.326165 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.325715 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:56:33.326165 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.326102 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:56:33.326367 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:33.326346 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:56:33.752793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.752764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:56:33.752941 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.752823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:56:33.753144 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:33.753131 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:56:33.753309 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:33.753292 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:56:45.366551 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:45.366518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:56:45.467364 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:45.467324 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:56:47.390552 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:47.390524 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:56:47.390970 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:47.390707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:56:48.390230 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:48.390198 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:56:48.390412 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:48.390364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:56:59.390887 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:56:59.390855 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:56:59.391277 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:56:59.391035 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:01.390521 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:01.390488 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:57:01.390948 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:01.390696 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:12.392843 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:12.392803 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:57:12.817850 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:12.817816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerStarted","Data":"772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab"} Jun 11 21:57:12.818043 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:12.818026 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:57:12.833359 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:12.833315 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podStartSLOduration=97.370120471 podStartE2EDuration="1m40.83329415s" totalImagesPullingTime="3.463173679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:55:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:57:12.830951875 +0000 UTC m=+840.898723010" watchObservedRunningTime="2026-06-11 21:57:12.83329415 +0000 UTC m=+840.901065286" Jun 11 21:57:13.390155 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.390125 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:57:13.824278 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.824242 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" exitCode=1 Jun 11 21:57:13.824715 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.824324 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" event={"ID":"dfb36e0f-7c7e-48b8-8415-57f046dae3d4","Type":"ContainerDied","Data":"772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab"} Jun 11 21:57:13.824715 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.824404 2581 scope.go:117] "RemoveContainer" containerID="a88e389b1ff432179ca2e061fa4b5bb8651faec6491f469b8d5697a7139d554d" Jun 11 21:57:13.824715 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.824620 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:13.824883 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:13.824865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:13.826241 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.826222 2581 generic.go:356] "Generic (PLEG): container finished" podID="ce9403e1-4ffb-428d-86e9-253960b8aa61" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" exitCode=1 Jun 11 21:57:13.826319 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.826263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" event={"ID":"ce9403e1-4ffb-428d-86e9-253960b8aa61","Type":"ContainerDied","Data":"2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892"} Jun 11 21:57:13.826513 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.826499 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:57:13.826703 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:13.826687 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:13.835455 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:13.835431 2581 scope.go:117] "RemoveContainer" containerID="cd4f9ccf5471d613e96d5bf8fe049c44770df1cb9c1c27db08c98c177c177c6e" Jun 11 21:57:14.834433 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:14.834407 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:14.834859 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:14.834588 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:23.752102 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:23.752067 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:57:23.752582 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:23.752427 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:57:23.752626 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:23.752598 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:30.391059 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:30.391023 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:30.391440 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:30.391253 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:33.326154 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:33.326101 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" Jun 11 21:57:33.326626 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:33.326607 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:33.326877 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:33.326852 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:33.454333 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:33.454298 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4fc7c657-t52xl_000cf964-1946-4b9d-bda4-5be8467d67c6/authorino/0.log" Jun 11 21:57:33.752704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:33.752650 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" Jun 11 21:57:33.753060 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:33.753047 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:57:33.753247 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:33.753229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:37.060704 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:37.060677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57f6c5ffb7-7sl5x_ce9403e1-4ffb-428d-86e9-253960b8aa61/manager/4.log" Jun 11 21:57:37.165551 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:37.165523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75fd78dd4b-g9gqt_dfb36e0f-7c7e-48b8-8415-57f046dae3d4/manager/4.log" Jun 11 21:57:37.497291 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:37.497265 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb_4c48c937-7c2b-4f59-bc58-8ed38ee12cfd/copy-manifests/0.log" Jun 11 21:57:37.503751 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:37.503728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb_4c48c937-7c2b-4f59-bc58-8ed38ee12cfd/manager/0.log" Jun 11 21:57:39.014175 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:39.014139 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4fc7c657-t52xl_000cf964-1946-4b9d-bda4-5be8467d67c6/authorino/0.log" Jun 11 21:57:39.128647 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:39.128616 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k6k9c_e1f9417f-67bd-4f00-8faa-0d45033c9f41/manager/0.log" Jun 11 21:57:40.334253 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:40.334223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b555db89-fcxst_501ffd46-36bc-4b61-972c-85f53b5ae3b1/kube-auth-proxy/0.log" Jun 11 21:57:40.662391 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:40.662309 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log" Jun 11 21:57:44.813174 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:44.813136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:57:44.878588 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:44.878542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:57:46.390732 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:46.390701 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:57:46.391143 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:46.390879 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:47.671446 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:47.671420 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-65tgf_8e5123d9-bf98-4743-9157-eca3ab0a2be4/global-pull-secret-syncer/0.log" Jun 11 21:57:47.714548 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:47.714516 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" Jun 11 21:57:47.833089 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:47.833057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-164.ec2.internal_1234a3e78b8179c285836e565965a2a2/haproxy/0.log" Jun 11 21:57:48.390682 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:48.390633 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:48.390873 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:48.390835 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:57:52.553782 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:52.553754 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4fc7c657-t52xl_000cf964-1946-4b9d-bda4-5be8467d67c6/authorino/0.log" Jun 11 21:57:52.595008 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:52.594921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-k6k9c_e1f9417f-67bd-4f00-8faa-0d45033c9f41/manager/0.log" Jun 11 21:57:54.905533 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:54.905501 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/node-exporter/0.log" Jun 11 21:57:54.933412 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:54.933374 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/kube-rbac-proxy/0.log" Jun 11 21:57:54.953614 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:54.953595 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8rjxp_efde7a37-1390-4465-94fc-80d45de68e10/init-textfile/0.log" Jun 11 21:57:55.178870 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.178841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/prometheus/0.log" Jun 11 21:57:55.200883 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.200855 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/config-reloader/0.log" Jun 11 21:57:55.222938 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.222916 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/thanos-sidecar/0.log" Jun 11 21:57:55.251347 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.251323 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/kube-rbac-proxy-web/0.log" Jun 11 21:57:55.269834 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.269812 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/kube-rbac-proxy/0.log" Jun 11 21:57:55.288681 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.288637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/kube-rbac-proxy-thanos/0.log" Jun 11 21:57:55.309429 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.309407 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_414c67c3-e537-4d95-9633-86a491aef240/init-config-reloader/0.log" Jun 11 21:57:55.341006 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.340979 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-hz5dg_ee7643fe-eae0-4171-907a-7f53bec004e6/prometheus-operator/0.log" Jun 11 21:57:55.356595 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.356568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-hz5dg_ee7643fe-eae0-4171-907a-7f53bec004e6/kube-rbac-proxy/0.log" Jun 11 21:57:55.487443 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.487415 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/thanos-query/0.log" Jun 11 21:57:55.506419 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.506397 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-web/0.log" Jun 11 21:57:55.524525 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.524507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy/0.log" Jun 11 21:57:55.542842 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.542811 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/prom-label-proxy/0.log" Jun 11 21:57:55.560769 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.560739 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-rules/0.log" Jun 11 21:57:55.582059 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:55.582038 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b48b845cb-xq4rt_77899376-eb76-40fe-82cb-be958a183223/kube-rbac-proxy-metrics/0.log" Jun 11 21:57:57.065998 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.065963 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-pc5lv_c11c31e7-b296-497a-acbf-efdbf6e33fc9/networking-console-plugin/0.log" Jun 11 21:57:57.870981 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.870951 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb"] Jun 11 21:57:57.874330 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.874308 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:57.876069 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.876047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fcg\"/\"openshift-service-ca.crt\"" Jun 11 21:57:57.876421 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.876404 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fcg\"/\"kube-root-ca.crt\"" Jun 11 21:57:57.876498 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.876407 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6fcg\"/\"default-dockercfg-sbjrx\"" Jun 11 21:57:57.883637 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.883615 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb"] Jun 11 21:57:57.958566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.958534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxhq9\" (UniqueName: \"kubernetes.io/projected/c6ae316a-a6f1-440e-9717-5330a02d45be-kube-api-access-jxhq9\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:57.958566 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.958568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-lib-modules\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:57.958841 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.958592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-proc\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:57.958841 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.958702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-podres\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:57.958841 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:57.958742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-sys\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060176 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxhq9\" (UniqueName: \"kubernetes.io/projected/c6ae316a-a6f1-440e-9717-5330a02d45be-kube-api-access-jxhq9\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060176 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-lib-modules\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060197 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-proc\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060230 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-podres\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060250 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-sys\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-lib-modules\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060346 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-sys\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-proc\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.060401 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.060396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6ae316a-a6f1-440e-9717-5330a02d45be-podres\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.067231 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.067204 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxhq9\" (UniqueName: \"kubernetes.io/projected/c6ae316a-a6f1-440e-9717-5330a02d45be-kube-api-access-jxhq9\") pod \"perf-node-gather-daemonset-w6tqb\" (UID: \"c6ae316a-a6f1-440e-9717-5330a02d45be\") " pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.184536 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.184443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:58.320160 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:58.320125 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb"] Jun 11 21:57:58.323124 ip-10-0-141-164 kubenswrapper[2581]: W0611 21:57:58.323096 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6ae316a_a6f1_440e_9717_5330a02d45be.slice/crio-aecf05ff00af59d7225b99e99bca9f21b484976fb75c9206b5ae53d199c12ce5 WatchSource:0}: Error finding container aecf05ff00af59d7225b99e99bca9f21b484976fb75c9206b5ae53d199c12ce5: Status 404 returned error can't find the container with id aecf05ff00af59d7225b99e99bca9f21b484976fb75c9206b5ae53d199c12ce5 Jun 11 21:57:59.034627 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.034590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" event={"ID":"c6ae316a-a6f1-440e-9717-5330a02d45be","Type":"ContainerStarted","Data":"ba8dd6229aa108f878b5139fcc69f87794b09f589c1266fce35dc8a193062738"} Jun 11 21:57:59.034995 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.034674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" event={"ID":"c6ae316a-a6f1-440e-9717-5330a02d45be","Type":"ContainerStarted","Data":"aecf05ff00af59d7225b99e99bca9f21b484976fb75c9206b5ae53d199c12ce5"} Jun 11 21:57:59.034995 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.034727 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:57:59.050443 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.050391 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" podStartSLOduration=2.050378938 podStartE2EDuration="2.050378938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:57:59.048259747 +0000 UTC m=+887.116030883" watchObservedRunningTime="2026-06-11 21:57:59.050378938 +0000 UTC m=+887.118150072" Jun 11 21:57:59.390323 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.390233 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:57:59.390705 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:57:59.390360 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:57:59.390705 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:59.390470 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:57:59.390705 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:57:59.390491 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:58:00.139535 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:00.139508 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94ddb_7689cdfb-5638-4ca9-99dd-4a379f1b4a69/dns/0.log" Jun 11 21:58:00.157870 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:00.157843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-94ddb_7689cdfb-5638-4ca9-99dd-4a379f1b4a69/kube-rbac-proxy/0.log" Jun 11 21:58:00.260891 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:00.260860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l9zrf_386b7758-2d4f-4e98-bc8a-688929d3e998/dns-node-resolver/0.log" Jun 11 21:58:00.836272 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:00.836231 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b6d6_da4b4611-50bd-48e4-91e7-3d724f3159d4/node-ca/0.log" Jun 11 21:58:01.890593 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:01.890562 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b555db89-fcxst_501ffd46-36bc-4b61-972c-85f53b5ae3b1/kube-auth-proxy/0.log" Jun 11 21:58:01.958158 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:01.958124 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log" Jun 11 21:58:02.618140 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:02.618106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpz6t_3c9f259d-d75b-4318-bc9c-47a70786d29c/serve-healthcheck-canary/0.log" Jun 11 21:58:03.160757 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.160710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-wlz8d_03928bf9-3655-4af2-b415-05d3351ecb09/insights-operator/0.log" Jun 11 21:58:03.163737 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.163705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-wlz8d_03928bf9-3655-4af2-b415-05d3351ecb09/insights-operator/1.log" Jun 11 21:58:03.257061 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.257026 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnn22_10b62ea8-02f6-4334-aa25-10e13049b27f/kube-rbac-proxy/0.log" Jun 11 21:58:03.277645 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.277619 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnn22_10b62ea8-02f6-4334-aa25-10e13049b27f/exporter/0.log" Jun 11 21:58:03.302940 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.302907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnn22_10b62ea8-02f6-4334-aa25-10e13049b27f/extractor/0.log" Jun 11 21:58:03.439962 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:03.439880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k5th4_bf6333fc-dfc3-4d00-b2f8-8e49c5dfed64/konnectivity-agent/0.log" limit=1024 Jun 11 21:58:05.049797 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.049764 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6fcg/perf-node-gather-daemonset-w6tqb" Jun 11 21:58:05.687576 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.687550 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57f6c5ffb7-7sl5x_ce9403e1-4ffb-428d-86e9-253960b8aa61/manager/4.log" Jun 11 21:58:05.687576 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.687566 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-57f6c5ffb7-7sl5x_ce9403e1-4ffb-428d-86e9-253960b8aa61/manager/4.log" Jun 11 21:58:05.704489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.704461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75fd78dd4b-g9gqt_dfb36e0f-7c7e-48b8-8415-57f046dae3d4/manager/4.log" Jun 11 21:58:05.704489 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.704472 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75fd78dd4b-g9gqt_dfb36e0f-7c7e-48b8-8415-57f046dae3d4/manager/4.log" Jun 11 21:58:05.787781 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.787748 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb_4c48c937-7c2b-4f59-bc58-8ed38ee12cfd/manager/0.log" Jun 11 21:58:05.805793 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:05.805771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f8f7bf7b9-lw2tb_4c48c937-7c2b-4f59-bc58-8ed38ee12cfd/copy-manifests/0.log" Jun 11 21:58:07.690939 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:07.690864 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4898ff9d-bd4zr_b75158ca-d4a1-4e4a-aba1-fad094381215/manager/0.log" Jun 11 21:58:12.413168 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:12.413142 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:58:12.413168 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:12.413153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk4q7_a8e6a01f-41c0-4655-8d69-a619baad3359/ovn-acl-logging/0.log" Jun 11 21:58:12.810213 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:12.810180 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b555db89-fcxst_501ffd46-36bc-4b61-972c-85f53b5ae3b1/kube-auth-proxy/0.log" Jun 11 21:58:12.854760 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:12.854730 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log" Jun 11 21:58:13.389857 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:13.389830 2581 scope.go:117] "RemoveContainer" containerID="2ba4d18e7d8e9bfd95e2d11ecd71c723ae9c14e6956f3128d0c2e0d27628b892" Jun 11 21:58:13.390033 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:58:13.389994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-57f6c5ffb7-7sl5x_opendatahub(ce9403e1-4ffb-428d-86e9-253960b8aa61)\"" pod="opendatahub/maas-controller-57f6c5ffb7-7sl5x" podUID="ce9403e1-4ffb-428d-86e9-253960b8aa61" Jun 11 21:58:14.050554 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.050467 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b555db89-fcxst_501ffd46-36bc-4b61-972c-85f53b5ae3b1/kube-auth-proxy/0.log" Jun 11 21:58:14.096593 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.096562 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log" Jun 11 21:58:14.390316 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.390237 2581 scope.go:117] "RemoveContainer" containerID="772792743f286ad0f02e9e6df8af72116acd1f1e6b663d44de62bd128f6619ab" Jun 11 21:58:14.390512 ip-10-0-141-164 kubenswrapper[2581]: E0611 21:58:14.390477 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-75fd78dd4b-g9gqt_opendatahub(dfb36e0f-7c7e-48b8-8415-57f046dae3d4)\"" pod="opendatahub/maas-controller-75fd78dd4b-g9gqt" podUID="dfb36e0f-7c7e-48b8-8415-57f046dae3d4" Jun 11 21:58:14.403666 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.403639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/kube-multus-additional-cni-plugins/0.log" Jun 11 21:58:14.422975 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.422948 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/egress-router-binary-copy/0.log" Jun 11 21:58:14.443593 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.443564 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/cni-plugins/0.log" Jun 11 21:58:14.462024 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.462004 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/bond-cni-plugin/0.log" Jun 11 21:58:14.479677 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.479635 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/routeoverride-cni/0.log" Jun 11 21:58:14.496690 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.496651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/whereabouts-cni-bincopy/0.log" Jun 11 21:58:14.514494 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.514471 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-btxbh_e8bc00a4-4aa5-48b1-b94d-6afe34ddc2b7/whereabouts-cni/0.log" Jun 11 21:58:14.889710 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.889680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tg966_364332cd-a702-443e-ab66-63584920b879/kube-multus/0.log" Jun 11 21:58:14.907312 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.907285 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4zm4q_889db87a-4683-4dc3-9f77-6f624179cfcd/network-metrics-daemon/0.log" Jun 11 21:58:14.926453 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:14.926429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4zm4q_889db87a-4683-4dc3-9f77-6f624179cfcd/kube-rbac-proxy/0.log" Jun 11 21:58:15.676607 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:15.676575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b555db89-fcxst_501ffd46-36bc-4b61-972c-85f53b5ae3b1/kube-auth-proxy/0.log" Jun 11 21:58:15.736156 ip-10-0-141-164 kubenswrapper[2581]: I0611 21:58:15.736131 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-798967cdf8-qklkj_555624e4-380d-4b49-ae5b-ae20e7038c64/router/0.log"