Jul 28 13:46:15.491215 ip-10-0-141-91 systemd[1]: Starting Kubernetes Kubelet... Jul 28 13:46:15.900829 ip-10-0-141-91 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:15.900829 ip-10-0-141-91 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 13:46:15.900829 ip-10-0-141-91 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:15.900829 ip-10-0-141-91 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 13:46:15.900829 ip-10-0-141-91 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:46:15.903205 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.903122 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 13:46:15.907291 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907277 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.907291 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907293 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907299 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907304 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907307 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907310 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907313 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907316 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907318 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907321 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907323 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907326 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907329 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907331 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907334 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907336 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907339 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907342 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907344 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907346 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907349 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.907358 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907351 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907354 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907356 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907359 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907361 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907364 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907367 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907370 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907373 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907376 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907378 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907381 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907383 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907386 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907388 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907390 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907394 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907396 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907398 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907402 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.907851 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907404 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907407 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907409 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907411 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907414 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907416 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907418 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907421 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907423 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907426 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907428 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907430 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907433 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907436 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907439 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907441 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907444 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907446 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907449 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907451 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.908337 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907454 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907457 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907462 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907465 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907467 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907470 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907473 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907475 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907478 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907480 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907483 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907485 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907487 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907490 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907492 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907495 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907497 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907500 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907502 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.908824 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907506 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907509 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907511 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907514 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907516 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907519 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907522 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907525 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907527 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907530 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907532 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907535 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907537 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907540 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907542 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907545 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907547 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907550 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.907552 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908942 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.909307 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908951 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908954 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908957 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908960 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908962 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908991 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908995 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.908998 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909000 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909003 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909006 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909008 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909011 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909013 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909016 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909019 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909021 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909024 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909026 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909032 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.909773 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909036 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909039 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909042 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909044 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909047 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909050 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909052 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909055 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909058 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909061 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909063 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909066 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909068 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909071 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909073 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909075 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909078 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909081 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909083 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909085 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.910266 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909088 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909090 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909093 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909095 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909097 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909100 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909103 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909105 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909108 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909110 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909113 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909116 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909120 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909123 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909125 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909128 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909130 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909133 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909135 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909139 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.910732 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909142 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909149 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909151 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909154 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909156 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909159 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909161 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909164 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909166 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909170 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909173 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909175 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909177 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909180 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909182 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909184 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909187 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909189 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909192 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909195 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.911219 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909197 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909199 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909202 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909206 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909208 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909211 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909213 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909215 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909218 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909220 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909223 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909225 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909228 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909230 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909234 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909237 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909240 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909243 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909581 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.911706 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909587 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909589 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909593 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909595 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909598 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909601 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909603 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909606 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909608 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909610 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909613 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909616 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909618 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909621 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909623 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909626 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909630 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909632 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909635 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909637 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.912225 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909640 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909643 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909645 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909648 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909650 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909653 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909655 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909658 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909661 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909663 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909665 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909668 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909670 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909673 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909675 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909678 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909680 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909683 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909685 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909687 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.912728 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909690 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909692 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909694 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909697 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909699 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909701 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909704 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909706 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909710 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909713 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909715 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909718 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909720 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909723 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909725 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909728 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909731 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909733 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909736 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909738 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.913229 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909742 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909744 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909746 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909749 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909753 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909756 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909759 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909761 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909764 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909766 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909768 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909770 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909773 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909776 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909778 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909781 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909785 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909788 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909791 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.913698 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909794 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909798 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909801 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909803 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909807 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909810 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909813 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909816 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909819 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909821 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909824 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909827 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909829 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909832 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909835 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909837 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909839 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909842 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.909844 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909908 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 13:46:15.914190 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909915 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909920 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909924 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909928 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909931 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909935 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909940 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909943 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909946 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909949 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909952 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909955 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909958 2554 flags.go:64] FLAG: --cgroup-root="" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909961 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909964 2554 flags.go:64] FLAG: --client-ca-file="" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909967 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909982 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909987 2554 flags.go:64] FLAG: --cluster-domain="" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909990 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909992 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909995 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.909999 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910002 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 13:46:15.914639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910005 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910008 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910011 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910014 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910018 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910020 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910023 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910026 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910030 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910033 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910036 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910038 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910041 2554 flags.go:64] FLAG: --enable-server="true" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910044 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910049 2554 flags.go:64] FLAG: --event-burst="100" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910053 2554 flags.go:64] FLAG: --event-qps="50" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910055 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910058 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910061 2554 flags.go:64] FLAG: --eviction-hard="" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910065 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910068 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910071 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910074 2554 flags.go:64] FLAG: --eviction-soft="" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910077 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910080 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 13:46:15.915225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910082 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910085 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910088 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910090 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910093 2554 flags.go:64] FLAG: --feature-gates="" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910097 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910100 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910102 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910105 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910108 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910111 2554 flags.go:64] FLAG: --help="false" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910114 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-141-91.ec2.internal" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910117 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910120 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910122 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910125 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910129 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910131 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910134 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910137 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910140 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910142 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910148 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910151 2554 flags.go:64] FLAG: --kube-reserved="" Jul 28 13:46:15.915853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910153 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910156 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910159 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910162 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910164 2554 flags.go:64] FLAG: --lock-file="" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910167 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910170 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910173 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910183 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910186 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910188 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910191 2554 flags.go:64] FLAG: --logging-format="text" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910194 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910197 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910200 2554 flags.go:64] FLAG: --manifest-url="" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910202 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910206 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910209 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910213 2554 flags.go:64] FLAG: --max-pods="110" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910215 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910218 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910221 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910224 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910227 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910230 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 13:46:15.916484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910232 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910239 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910242 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910245 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910247 2554 flags.go:64] FLAG: --pod-cidr="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910251 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910257 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910260 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910263 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910266 2554 flags.go:64] FLAG: --port="10250" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910268 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910271 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0beab9c171ba6ef86" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910274 2554 flags.go:64] FLAG: --qos-reserved="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910279 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910282 2554 flags.go:64] FLAG: --register-node="true" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910285 2554 flags.go:64] FLAG: --register-with-taints="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910288 2554 flags.go:64] FLAG: --registry-burst="10" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910291 2554 flags.go:64] FLAG: --registry-qps="5" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910294 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910297 2554 flags.go:64] FLAG: --reserved-memory="" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910300 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910304 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910306 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910309 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910312 2554 flags.go:64] FLAG: --runonce="false" Jul 28 13:46:15.917223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910315 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910318 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910320 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910323 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910327 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910330 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910332 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910335 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910338 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910341 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910344 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910347 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910351 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910353 2554 flags.go:64] FLAG: --system-cgroups="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910356 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910361 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910363 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910366 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910371 2554 flags.go:64] FLAG: --tls-min-version="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910374 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910378 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910381 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910384 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910387 2554 flags.go:64] FLAG: --v="2" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910390 2554 flags.go:64] FLAG: --version="false" Jul 28 13:46:15.918209 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910394 2554 flags.go:64] FLAG: --vmodule="" Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910398 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.910401 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910524 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910527 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910530 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910533 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910536 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910538 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910541 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910544 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910546 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910551 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910554 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910557 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910561 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910565 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910568 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910570 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.919027 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910574 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910576 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910579 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910581 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910583 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910587 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910590 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910593 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910597 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910599 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910602 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910605 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910607 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910610 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910613 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910615 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910617 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910620 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910622 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.919515 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910625 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910627 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910629 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910632 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910634 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910637 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910640 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910643 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910646 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910649 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910651 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910654 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910656 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910660 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910663 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910666 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910668 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910670 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910673 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910675 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.920074 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910678 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910682 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910684 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910687 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910689 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910692 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910694 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910697 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910699 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910702 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910704 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910707 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910709 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910712 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910714 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910716 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910719 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910721 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910724 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910727 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.920559 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910729 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910732 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910734 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910737 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910740 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910743 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910746 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910748 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910751 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910753 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910756 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910758 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910760 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910764 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910767 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910769 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910772 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910774 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910777 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910779 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.921070 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910782 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910784 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910787 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.910789 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.911418 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.919280 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.919294 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.920022 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.920031 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920088 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920093 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920096 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920099 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920102 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920105 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.921540 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920108 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920110 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920113 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920115 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920118 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920121 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920123 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920125 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920128 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920130 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920133 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920135 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920138 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920141 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920144 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920147 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920149 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920152 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920154 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920157 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.921890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920159 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920162 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920164 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920168 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920172 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920176 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920179 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920182 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920185 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920188 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920190 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920193 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920197 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920200 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920203 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920206 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920208 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920211 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920213 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.922365 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920216 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920219 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920222 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920224 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920227 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920230 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920232 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920235 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920237 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920240 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920243 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920245 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920248 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920250 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920253 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920255 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920260 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920264 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920267 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920269 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.922813 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920272 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920274 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920277 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920279 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920282 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920284 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920287 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920289 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920292 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920294 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920297 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920299 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920302 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920304 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920307 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920309 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920312 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920314 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920317 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.923329 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920319 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920322 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920325 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920327 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920330 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920332 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920335 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920338 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920340 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920343 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920346 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920349 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920351 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920354 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920356 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.923797 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.920361 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920492 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920497 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920500 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920504 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920506 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920509 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920511 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920514 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920517 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920520 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920522 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920525 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920528 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920531 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920533 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920536 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920538 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920541 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920543 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:46:15.924201 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920546 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920549 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920551 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920554 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920556 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920559 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920561 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920564 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920567 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920570 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920573 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920575 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920579 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920583 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920586 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920588 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920591 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920593 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920595 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:46:15.924758 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920598 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920600 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920603 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920605 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920608 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920610 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920613 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920615 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920618 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920620 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920623 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920625 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920628 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920631 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920633 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920636 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920638 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920641 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920643 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920646 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:46:15.925330 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920649 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920651 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920653 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920656 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920658 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920661 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920664 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920666 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920669 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920671 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920674 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920676 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920680 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920683 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920686 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920688 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920691 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920693 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920696 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:46:15.925787 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920698 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920701 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920704 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920706 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920709 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920711 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920714 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920716 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920719 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920721 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920724 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920726 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920729 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920732 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920734 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920737 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920739 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920743 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920747 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920750 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:46:15.926528 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920752 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:15.920755 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.920759 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.920869 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.922731 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.924086 2554 server.go:1019] "Starting client certificate rotation" Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.924205 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.924255 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:46:15.927189 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.927181 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:46:15.928330 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.928305 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:46:15.937467 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.937452 2554 log.go:25] "Validated CRI v1 runtime API" Jul 28 13:46:15.939562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.939546 2554 log.go:25] "Validated CRI v1 image API" Jul 28 13:46:15.942528 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.942512 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 13:46:15.944625 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.944608 2554 fs.go:135] Filesystem UUIDs: map[1035b4d8-fbe1-4074-a1ce-9667be9f075b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f8a47179-c3f2-45ba-b1bc-fe3ae2a0e4c3:/dev/nvme0n1p3] Jul 28 13:46:15.944690 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.944625 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 13:46:15.950112 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.950013 2554 manager.go:216] Machine: {Timestamp:2026-07-28 13:46:15.948752373 +0000 UTC m=+0.338723570 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3151917 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec224b3a735e359b95026e194d6ba92e SystemUUID:ec224b3a-735e-359b-9502-6e194d6ba92e BootID:451ee883-1490-4934-be7c-557017007b3f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:38:7f:c9:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:38:7f:c9:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:f0:e9:2a:86:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 13:46:15.950112 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.950102 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 13:46:15.950229 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.950168 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 13:46:15.952991 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.952945 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 13:46:15.953146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.952996 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 13:46:15.953744 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.953732 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 13:46:15.953796 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.953748 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 13:46:15.953796 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.953758 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:46:15.956339 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.955708 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:46:15.956339 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.955992 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:46:15.956772 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.956758 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 13:46:15.958460 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958448 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:46:15.958578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958569 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 13:46:15.958610 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958601 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 28 13:46:15.958637 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958614 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 13:46:15.958637 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958632 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 13:46:15.958686 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958644 2554 kubelet.go:398] "Adding apiserver pod source" Jul 28 13:46:15.958686 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.958655 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 13:46:15.959087 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.959074 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:46:15.959158 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.959099 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:46:15.961015 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.960996 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 13:46:15.963048 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.963032 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 13:46:15.963119 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.963070 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 13:46:15.965315 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965303 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965319 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965325 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965330 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965339 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965344 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965351 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965356 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965362 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965367 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965375 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 13:46:15.965381 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.965380 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 13:46:15.966076 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.966061 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 13:46:15.966076 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.966077 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 13:46:15.968591 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.968570 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 13:46:15.968753 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.968724 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 13:46:15.968878 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.968860 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 13:46:15.969154 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.969142 2554 server.go:1268] "Started kubelet" Jul 28 13:46:15.969344 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.969266 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 13:46:15.969403 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.969364 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 13:46:15.969403 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.969379 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 13:46:15.969908 ip-10-0-141-91 systemd[1]: Started Kubernetes Kubelet. Jul 28 13:46:15.971104 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.971088 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 13:46:15.971730 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.971713 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 28 13:46:15.974419 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.974405 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pnf6" Jul 28 13:46:15.975851 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.975831 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 13:46:15.978985 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.978961 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 13:46:15.979058 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979000 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 13:46:15.979431 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.979138 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:15.979527 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979511 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 13:46:15.979591 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979571 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 13:46:15.979591 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979584 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 13:46:15.979684 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979663 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 28 13:46:15.979684 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979669 2554 factory.go:55] Registering systemd factory Jul 28 13:46:15.979684 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979683 2554 factory.go:223] Registration of the systemd container factory successfully Jul 28 13:46:15.979825 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979674 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 28 13:46:15.979939 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979921 2554 factory.go:153] Registering CRI-O factory Jul 28 13:46:15.979939 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.979939 2554 factory.go:223] Registration of the crio container factory successfully Jul 28 13:46:15.980142 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.980002 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 13:46:15.980142 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.980026 2554 factory.go:103] Registering Raw factory Jul 28 13:46:15.980142 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.980040 2554 manager.go:1196] Started watching for new ooms in manager Jul 28 13:46:15.980396 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.980383 2554 manager.go:349] Starting recovery of all containers Jul 28 13:46:15.982090 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.982064 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2pnf6" Jul 28 13:46:15.984335 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.984297 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 13:46:15.985364 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.984398 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-91.ec2.internal.18c6781ecc315971 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-91.ec2.internal,UID:ip-10-0-141-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-91.ec2.internal,},FirstTimestamp:2026-07-28 13:46:15.969118577 +0000 UTC m=+0.359089819,LastTimestamp:2026-07-28 13:46:15.969118577 +0000 UTC m=+0.359089819,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-91.ec2.internal,}" Jul 28 13:46:15.985476 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:15.985448 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 13:46:15.989929 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.989895 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 13:46:15.992447 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.992428 2554 manager.go:354] Recovery completed Jul 28 13:46:15.998612 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:15.998596 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.000837 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.000817 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.000932 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.000850 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.000932 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.000865 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.001403 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.001388 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 13:46:16.001403 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.001400 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.001520 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.001402 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 13:46:16.001520 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.001465 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:46:16.002843 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.002827 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.002910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.002857 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.002910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.002870 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.080262 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.080237 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.148853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.133901 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 13:46:16.148853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.133940 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 13:46:16.148853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.133962 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 13:46:16.148853 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.134021 2554 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 28 13:46:16.148853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.136767 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:16.149341 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.149228 2554 policy_none.go:49] "None policy: Start" Jul 28 13:46:16.149341 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.149242 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 13:46:16.149341 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.149253 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 13:46:16.150361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.150348 2554 policy_none.go:47] "Start" Jul 28 13:46:16.176593 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.176460 2554 manager.go:337] "Starting Device Plugin manager" Jul 28 13:46:16.176695 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.176613 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 13:46:16.176695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.176626 2554 server.go:87] "Starting device plugin registration server" Jul 28 13:46:16.176866 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.176855 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 13:46:16.176904 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.176869 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 13:46:16.177041 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.177027 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 13:46:16.177142 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.177120 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 13:46:16.177142 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.177132 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 13:46:16.177696 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.177677 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 13:46:16.177775 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.177723 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.191020 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.191003 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-91.ec2.internal\" not found" node="ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.235121 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.235102 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal"] Jul 28 13:46:16.235179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.235155 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.236020 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.236007 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.236082 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.236041 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.236082 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.236056 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.237266 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237255 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.237385 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237371 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.237423 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237399 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.237913 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237898 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.238001 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237918 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.238001 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.237932 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.238073 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.238004 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.238073 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.238031 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.238073 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.238040 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.239169 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.239156 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.239214 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.239196 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.239871 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.239857 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.239936 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.239885 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.239936 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.239920 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.269613 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.269589 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-91.ec2.internal\" not found" node="ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.273854 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.273839 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-91.ec2.internal\" not found" node="ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.277620 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.277607 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:46:16.278351 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.278336 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:46:16.278431 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.278364 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:46:16.278431 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.278376 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:46:16.278431 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.278393 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.280522 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.280507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.280572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.280529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.280572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.280545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e3722b3da67d4e99a57997b921b163-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"22e3722b3da67d4e99a57997b921b163\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.286271 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.286259 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.286325 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.286277 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-91.ec2.internal\": node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.314321 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.314296 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.381212 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.381336 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381217 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.381336 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.381336 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e3722b3da67d4e99a57997b921b163-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"22e3722b3da67d4e99a57997b921b163\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.381336 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381310 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22e3722b3da67d4e99a57997b921b163-config\") pod \"kube-apiserver-proxy-ip-10-0-141-91.ec2.internal\" (UID: \"22e3722b3da67d4e99a57997b921b163\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.381456 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.381347 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/123569e86275469bca87afde54f1bea6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal\" (UID: \"123569e86275469bca87afde54f1bea6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.415288 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.415237 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.516038 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.516001 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.573202 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.573167 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.577215 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.577105 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.617049 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.617021 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.717574 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.717496 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.817958 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.817920 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.918397 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:16.918367 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-91.ec2.internal\" not found" Jul 28 13:46:16.923956 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.923939 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 13:46:16.924118 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.924097 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:46:16.965579 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.965553 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:16.979503 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.979443 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 13:46:16.979503 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.979471 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" Jul 28 13:46:16.988469 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.988445 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:41:16 +0000 UTC" deadline="2028-04-10 04:29:12.7614837 +0000 UTC" Jul 28 13:46:16.988521 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.988470 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14918h42m55.77301662s" Jul 28 13:46:16.989803 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.989790 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:46:16.992360 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:16.992348 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" Jul 28 13:46:17.000103 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.000084 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:46:17.004968 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.004953 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:46:17.027745 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.027722 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzxrn" Jul 28 13:46:17.037280 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.037240 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kzxrn" Jul 28 13:46:17.341460 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:17.341419 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123569e86275469bca87afde54f1bea6.slice/crio-bb7c98dfe786f97e66c94ef52aa9da27c20305a28421e738e0d506d3d8dcc8ab WatchSource:0}: Error finding container bb7c98dfe786f97e66c94ef52aa9da27c20305a28421e738e0d506d3d8dcc8ab: Status 404 returned error can't find the container with id bb7c98dfe786f97e66c94ef52aa9da27c20305a28421e738e0d506d3d8dcc8ab Jul 28 13:46:17.346175 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.346157 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:46:17.391595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.391575 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:17.546737 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.546681 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:17.720551 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:17.720528 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e3722b3da67d4e99a57997b921b163.slice/crio-2351673266f7b06c2e9c6f36858dd06795b7b6e4fabeaebdcc8b692ad74e1996 WatchSource:0}: Error finding container 2351673266f7b06c2e9c6f36858dd06795b7b6e4fabeaebdcc8b692ad74e1996: Status 404 returned error can't find the container with id 2351673266f7b06c2e9c6f36858dd06795b7b6e4fabeaebdcc8b692ad74e1996 Jul 28 13:46:17.960716 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.960655 2554 apiserver.go:52] "Watching apiserver" Jul 28 13:46:17.969570 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.969531 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 13:46:17.969907 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.969886 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-jkmrc","openshift-multus/multus-4prm2","openshift-multus/network-metrics-daemon-n5546","openshift-network-diagnostics/network-check-target-xbjrs","openshift-network-operator/iptables-alerter-ncq86","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk","openshift-cluster-node-tuning-operator/tuned-dh8lm","openshift-dns/node-resolver-sqj4g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal","openshift-multus/multus-additional-cni-plugins-4pm8w","openshift-ovn-kubernetes/ovnkube-node-8l6c5","kube-system/global-pull-secret-syncer-2w4qv","kube-system/konnectivity-agent-f9zpj","kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal"] Jul 28 13:46:17.971556 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.971539 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:17.972747 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.972729 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.974135 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.974113 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:17.974245 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:17.974216 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:17.975119 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975098 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.975200 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975104 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.975277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975187 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:17.975351 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:17.975333 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:17.975725 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975711 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 13:46:17.975782 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975763 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kbxbk\"" Jul 28 13:46:17.975853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975808 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.975908 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975847 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 13:46:17.975960 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.975914 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.976168 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.976150 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ftq58\"" Jul 28 13:46:17.976248 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.976209 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 13:46:17.976642 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.976623 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:17.978073 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.978042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.979147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.979128 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.979320 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.979302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g8n9x\"" Jul 28 13:46:17.979395 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.979382 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 13:46:17.979456 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.979403 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.980071 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.980048 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.980276 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.980255 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.980380 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.980349 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 13:46:17.980967 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.980912 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.982986 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.981354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mc9tp\"" Jul 28 13:46:17.983455 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.983313 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.983544 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.983486 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fzdw7\"" Jul 28 13:46:17.983544 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.983531 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:17.983836 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.983805 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.985282 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.985266 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:17.986135 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.986118 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.986487 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.986472 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mrsbr\"" Jul 28 13:46:17.986567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.986474 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.987076 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.987053 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:17.987476 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.987272 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 13:46:17.987874 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.987792 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5zq5\"" Jul 28 13:46:17.987874 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.987826 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 13:46:17.988564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.988548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:17.988644 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:17.988623 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:17.989796 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.989777 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 13:46:17.989883 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.989868 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:17.990161 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.990144 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 13:46:17.991101 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991079 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cni-binary-copy\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-multus-certs\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991166 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-socket-dir-parent\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-kubelet\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-run\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991302 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-sys\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991330 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-tuned\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991354 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-tmp\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991364 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 13:46:17.991404 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991374 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eae876f-cc9a-42a9-a66d-6fad0520fc77-serviceca\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-bin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991449 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rqxb6\"" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-hostroot\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991492 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-daemon-config\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991507 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mxgf\" (UniqueName: \"kubernetes.io/projected/8fb47319-a07f-41ae-b273-5e100eed0f4f-kube-api-access-6mxgf\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991543 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991568 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df346386-76f9-4bf2-ab1e-3941c73abeda-iptables-alerter-script\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991596 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jdst\" (UniqueName: \"kubernetes.io/projected/e898eb0a-6831-4f1a-a2e2-b3017623fc39-kube-api-access-4jdst\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991620 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991620 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df346386-76f9-4bf2-ab1e-3941c73abeda-host-slash\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-socket-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-multus\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-kubernetes\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.991753 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991747 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-device-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-conf-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-etc-kubernetes\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-modprobe-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991859 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-lib-modules\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-var-lib-kubelet\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991895 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-registration-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqkgk\" (UniqueName: \"kubernetes.io/projected/fd67f80e-75ae-4165-a681-77163d4f2249-kube-api-access-tqkgk\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-system-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cnibin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.991994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992017 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-conf\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992124 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-systemd\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzg2s\" (UniqueName: \"kubernetes.io/projected/8373ee1d-2e45-4cc0-b58e-117849f3c24c-kube-api-access-rzg2s\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992163 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992215 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-sys-fs\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:17.992562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eae876f-cc9a-42a9-a66d-6fad0520fc77-host\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992274 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992294 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-k8s-cni-cncf-io\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992320 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n29wx\"" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-netns\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65ls5\" (UniqueName: \"kubernetes.io/projected/df346386-76f9-4bf2-ab1e-3941c73abeda-kube-api-access-65ls5\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992402 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysconfig\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992449 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-host\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992473 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hpdk\" (UniqueName: \"kubernetes.io/projected/5eae876f-cc9a-42a9-a66d-6fad0520fc77-kube-api-access-6hpdk\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:17.993386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:17.992496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-os-release\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.039270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.039247 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:41:17 +0000 UTC" deadline="2028-03-29 16:02:44.026907093 +0000 UTC" Jul 28 13:46:18.039270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.039268 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14642h16m25.987641722s" Jul 28 13:46:18.080930 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.080908 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 13:46:18.093139 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-hostroot\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.093231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093147 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-daemon-config\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.093231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mxgf\" (UniqueName: \"kubernetes.io/projected/8fb47319-a07f-41ae-b273-5e100eed0f4f-kube-api-access-6mxgf\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:18.093231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093184 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:18.093231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df346386-76f9-4bf2-ab1e-3941c73abeda-iptables-alerter-script\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.093231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-slash\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093264 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-hostroot\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-netd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df346386-76f9-4bf2-ab1e-3941c73abeda-host-slash\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95vjt\" (UniqueName: \"kubernetes.io/projected/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-kube-api-access-95vjt\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093519 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0949ff00-521c-489c-a074-8893c4c1b993-konnectivity-ca\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-kubernetes\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093617 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.093649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-kubernetes\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdgv6\" (UniqueName: \"kubernetes.io/projected/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-kube-api-access-pdgv6\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df346386-76f9-4bf2-ab1e-3941c73abeda-host-slash\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0949ff00-521c-489c-a074-8893c4c1b993-agent-certs\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-conf-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-modprobe-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-lib-modules\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-var-lib-kubelet\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093861 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-conf-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-registration-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093899 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-daemon-config\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.093965 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-registration-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-lib-modules\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-var-lib-kubelet\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-system-cni-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cnibin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094106 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:18.094578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094110 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-modprobe-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-conf\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094153 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-systemd\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094164 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cnibin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzg2s\" (UniqueName: \"kubernetes.io/projected/8373ee1d-2e45-4cc0-b58e-117849f3c24c-kube-api-access-rzg2s\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-sys-fs\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.094218 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094224 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-hosts-file\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094242 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df346386-76f9-4bf2-ab1e-3941c73abeda-iptables-alerter-script\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094282 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-conf\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.094290 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:18.594261473 +0000 UTC m=+2.984232663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094336 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eae876f-cc9a-42a9-a66d-6fad0520fc77-host\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094363 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094373 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-systemd\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-k8s-cni-cncf-io\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094393 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eae876f-cc9a-42a9-a66d-6fad0520fc77-host\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.095508 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-netns\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094423 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-k8s-cni-cncf-io\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094431 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-sys-fs\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjntk\" (UniqueName: \"kubernetes.io/projected/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-kube-api-access-pjntk\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094488 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-netns\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-systemd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.096484 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.094539 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097018 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.096953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-etc-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097112 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hpdk\" (UniqueName: \"kubernetes.io/projected/5eae876f-cc9a-42a9-a66d-6fad0520fc77-kube-api-access-6hpdk\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.097112 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-os-release\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097112 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cni-binary-copy\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-multus-certs\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097163 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-ovn\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-script-lib\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.097277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097250 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-kubelet\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-run\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097310 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-tuned\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-tmp-dir\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097364 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-kubelet\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-var-lib-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097458 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovn-node-metrics-cert\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097501 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eae876f-cc9a-42a9-a66d-6fad0520fc77-serviceca\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-bin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-socket-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-node-log\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097609 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jdst\" (UniqueName: \"kubernetes.io/projected/e898eb0a-6831-4f1a-a2e2-b3017623fc39-kube-api-access-4jdst\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-multus\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-device-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097750 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-os-release\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097781 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-kubelet-config\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.097806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cnibin\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097835 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-etc-kubernetes\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqkgk\" (UniqueName: \"kubernetes.io/projected/fd67f80e-75ae-4165-a681-77163d4f2249-kube-api-access-tqkgk\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097896 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.097951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-systemd-units\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098114 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-multus\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-bin\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098148 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-run\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-socket-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098188 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-device-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098200 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-etc-kubernetes\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-config\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-system-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098346 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65ls5\" (UniqueName: \"kubernetes.io/projected/df346386-76f9-4bf2-ab1e-3941c73abeda-kube-api-access-65ls5\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098360 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-system-cni-dir\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098379 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysconfig\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.098481 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098452 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysconfig\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-host\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-cni-bin\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.098497 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-env-overrides\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-dbus\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099136 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-socket-dir-parent\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-sys\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099182 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-tmp\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-netns\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.099249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099225 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-log-socket\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099355 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-multus-socket-dir-parent\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.099359 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.099389 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.099403 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099404 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-sys\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099440 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-run-multus-certs\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.099459 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:18.599442462 +0000 UTC m=+2.989413665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eae876f-cc9a-42a9-a66d-6fad0520fc77-serviceca\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099671 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd67f80e-75ae-4165-a681-77163d4f2249-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099715 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-host-var-lib-kubelet\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099717 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898eb0a-6831-4f1a-a2e2-b3017623fc39-os-release\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-host\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099772 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898eb0a-6831-4f1a-a2e2-b3017623fc39-cni-binary-copy\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099777 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 13:46:18.099889 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.099827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-sysctl-d\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.103646 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.103604 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-etc-tuned\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.103772 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.103663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8373ee1d-2e45-4cc0-b58e-117849f3c24c-tmp\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.103964 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.103947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mxgf\" (UniqueName: \"kubernetes.io/projected/8fb47319-a07f-41ae-b273-5e100eed0f4f-kube-api-access-6mxgf\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:18.104159 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.104134 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzg2s\" (UniqueName: \"kubernetes.io/projected/8373ee1d-2e45-4cc0-b58e-117849f3c24c-kube-api-access-rzg2s\") pod \"tuned-dh8lm\" (UID: \"8373ee1d-2e45-4cc0-b58e-117849f3c24c\") " pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.106185 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.106169 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqkgk\" (UniqueName: \"kubernetes.io/projected/fd67f80e-75ae-4165-a681-77163d4f2249-kube-api-access-tqkgk\") pod \"aws-ebs-csi-driver-node-8lnmk\" (UID: \"fd67f80e-75ae-4165-a681-77163d4f2249\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.109952 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.109934 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65ls5\" (UniqueName: \"kubernetes.io/projected/df346386-76f9-4bf2-ab1e-3941c73abeda-kube-api-access-65ls5\") pod \"iptables-alerter-ncq86\" (UID: \"df346386-76f9-4bf2-ab1e-3941c73abeda\") " pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.113288 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.113266 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hpdk\" (UniqueName: \"kubernetes.io/projected/5eae876f-cc9a-42a9-a66d-6fad0520fc77-kube-api-access-6hpdk\") pod \"node-ca-jkmrc\" (UID: \"5eae876f-cc9a-42a9-a66d-6fad0520fc77\") " pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.113460 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.113442 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jdst\" (UniqueName: \"kubernetes.io/projected/e898eb0a-6831-4f1a-a2e2-b3017623fc39-kube-api-access-4jdst\") pod \"multus-4prm2\" (UID: \"e898eb0a-6831-4f1a-a2e2-b3017623fc39\") " pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.139256 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.139206 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" event={"ID":"22e3722b3da67d4e99a57997b921b163","Type":"ContainerStarted","Data":"2351673266f7b06c2e9c6f36858dd06795b7b6e4fabeaebdcc8b692ad74e1996"} Jul 28 13:46:18.140506 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.140481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"123569e86275469bca87afde54f1bea6","Type":"ContainerStarted","Data":"bb7c98dfe786f97e66c94ef52aa9da27c20305a28421e738e0d506d3d8dcc8ab"} Jul 28 13:46:18.199959 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.199934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.199959 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.199965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-systemd-units\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200207 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-bin\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200207 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200064 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-bin\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200207 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-systemd-units\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200207 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-config\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200207 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200211 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-env-overrides\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-dbus\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200236 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-netns\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-log-socket\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200309 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-dbus\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-slash\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200339 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-netd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200364 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95vjt\" (UniqueName: \"kubernetes.io/projected/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-kube-api-access-95vjt\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.200470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200470 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0949ff00-521c-489c-a074-8893c4c1b993-konnectivity-ca\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdgv6\" (UniqueName: \"kubernetes.io/projected/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-kube-api-access-pdgv6\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0949ff00-521c-489c-a074-8893c4c1b993-agent-certs\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-system-cni-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-hosts-file\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200646 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-env-overrides\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200665 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200684 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-config\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200717 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-netns\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200717 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-log-socket\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200741 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-slash\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200747 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-cni-netd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200759 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200793 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjntk\" (UniqueName: \"kubernetes.io/projected/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-kube-api-access-pjntk\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-systemd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-etc-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200826 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-ovn\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200898 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-script-lib\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200901 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-hosts-file\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-tmp-dir\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-kubelet\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-var-lib-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovn-node-metrics-cert\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201099 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0949ff00-521c-489c-a074-8893c4c1b993-konnectivity-ca\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.201120 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201174 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-node-log\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.201197 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:18.701160844 +0000 UTC m=+3.091132037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201223 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-system-cni-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-var-lib-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201121 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-node-log\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201318 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.201917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201315 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-kubelet\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-etc-openvswitch\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-os-release\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201384 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-ovn\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.200792 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201402 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-kubelet-config\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201373 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-tmp-dir\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201429 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cnibin\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-run-systemd\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201460 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-os-release\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21382e6a-33e2-412a-9f0e-996c44b89351-kubelet-config\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201500 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-host-run-ovn-kubernetes\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201507 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cnibin\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.201836 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.202812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.202266 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovnkube-script-lib\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.204261 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.204051 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-ovn-node-metrics-cert\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.204261 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.204219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0949ff00-521c-489c-a074-8893c4c1b993-agent-certs\") pod \"konnectivity-agent-f9zpj\" (UID: \"0949ff00-521c-489c-a074-8893c4c1b993\") " pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.210470 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.210447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdgv6\" (UniqueName: \"kubernetes.io/projected/8a6f00e0-9a1c-4aea-9eec-8e8204ec2856-kube-api-access-pdgv6\") pod \"ovnkube-node-8l6c5\" (UID: \"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856\") " pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.211220 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.211173 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjntk\" (UniqueName: \"kubernetes.io/projected/0cb490d4-9ef9-4952-9fc6-2b25ed3403ba-kube-api-access-pjntk\") pod \"multus-additional-cni-plugins-4pm8w\" (UID: \"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba\") " pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.211380 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.211361 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95vjt\" (UniqueName: \"kubernetes.io/projected/6c4841ce-8f2c-43ac-a4fb-c3da29cd236f-kube-api-access-95vjt\") pod \"node-resolver-sqj4g\" (UID: \"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f\") " pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.284740 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.284715 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jkmrc" Jul 28 13:46:18.291886 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.291867 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4prm2" Jul 28 13:46:18.294163 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.294136 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eae876f_cc9a_42a9_a66d_6fad0520fc77.slice/crio-edcc3bc2efaad47449242f763bfebfbe9e320f4193f6c815cf395ec636e2f691 WatchSource:0}: Error finding container edcc3bc2efaad47449242f763bfebfbe9e320f4193f6c815cf395ec636e2f691: Status 404 returned error can't find the container with id edcc3bc2efaad47449242f763bfebfbe9e320f4193f6c815cf395ec636e2f691 Jul 28 13:46:18.298960 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.298778 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncq86" Jul 28 13:46:18.303636 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.303599 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" Jul 28 13:46:18.304867 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.304836 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode898eb0a_6831_4f1a_a2e2_b3017623fc39.slice/crio-a5863e9cd010934cd1575980f9799bfeb048c67bdecfc820bc62cb4e4025022d WatchSource:0}: Error finding container a5863e9cd010934cd1575980f9799bfeb048c67bdecfc820bc62cb4e4025022d: Status 404 returned error can't find the container with id a5863e9cd010934cd1575980f9799bfeb048c67bdecfc820bc62cb4e4025022d Jul 28 13:46:18.309282 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.309259 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" Jul 28 13:46:18.310171 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.310152 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf346386_76f9_4bf2_ab1e_3941c73abeda.slice/crio-ef07c019f7279f44e7c31cf7cc180c791a1e09b0769a2be539f90215f6597208 WatchSource:0}: Error finding container ef07c019f7279f44e7c31cf7cc180c791a1e09b0769a2be539f90215f6597208: Status 404 returned error can't find the container with id ef07c019f7279f44e7c31cf7cc180c791a1e09b0769a2be539f90215f6597208 Jul 28 13:46:18.314087 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.314064 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd67f80e_75ae_4165_a681_77163d4f2249.slice/crio-1e6c41b8dba82d000b7db0a41e73e762e166e29eb59b7be9fda3e0f3f53a704c WatchSource:0}: Error finding container 1e6c41b8dba82d000b7db0a41e73e762e166e29eb59b7be9fda3e0f3f53a704c: Status 404 returned error can't find the container with id 1e6c41b8dba82d000b7db0a41e73e762e166e29eb59b7be9fda3e0f3f53a704c Jul 28 13:46:18.314760 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.314739 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sqj4g" Jul 28 13:46:18.318549 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.318527 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8373ee1d_2e45_4cc0_b58e_117849f3c24c.slice/crio-31d949a0aadc39664962c5b477994a761ab4292c4ba45425e36b46a750327a00 WatchSource:0}: Error finding container 31d949a0aadc39664962c5b477994a761ab4292c4ba45425e36b46a750327a00: Status 404 returned error can't find the container with id 31d949a0aadc39664962c5b477994a761ab4292c4ba45425e36b46a750327a00 Jul 28 13:46:18.320063 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.319962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" Jul 28 13:46:18.326002 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.325950 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:18.326243 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.326191 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4841ce_8f2c_43ac_a4fb_c3da29cd236f.slice/crio-909ec26f447a92bada411bac96b25cc8ed221eea5e8d9efafbc515e96067ceb4 WatchSource:0}: Error finding container 909ec26f447a92bada411bac96b25cc8ed221eea5e8d9efafbc515e96067ceb4: Status 404 returned error can't find the container with id 909ec26f447a92bada411bac96b25cc8ed221eea5e8d9efafbc515e96067ceb4 Jul 28 13:46:18.329771 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.329742 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb490d4_9ef9_4952_9fc6_2b25ed3403ba.slice/crio-6dc50e56e21a5b24a86a52e9277ab9b4f0cbb83d5a03aaa7c3bae8ce3eb314a9 WatchSource:0}: Error finding container 6dc50e56e21a5b24a86a52e9277ab9b4f0cbb83d5a03aaa7c3bae8ce3eb314a9: Status 404 returned error can't find the container with id 6dc50e56e21a5b24a86a52e9277ab9b4f0cbb83d5a03aaa7c3bae8ce3eb314a9 Jul 28 13:46:18.330141 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.329985 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:18.334828 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.334799 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a6f00e0_9a1c_4aea_9eec_8e8204ec2856.slice/crio-d3bf45e6bd43acaa06e725d016c67443850a52fbdf39df876e88e891a8a64302 WatchSource:0}: Error finding container d3bf45e6bd43acaa06e725d016c67443850a52fbdf39df876e88e891a8a64302: Status 404 returned error can't find the container with id d3bf45e6bd43acaa06e725d016c67443850a52fbdf39df876e88e891a8a64302 Jul 28 13:46:18.339543 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:18.339517 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0949ff00_521c_489c_a074_8893c4c1b993.slice/crio-46d26ac9fd19a8af46c9f59fff075a059a5b86052fba0ce6a71302adb465c908 WatchSource:0}: Error finding container 46d26ac9fd19a8af46c9f59fff075a059a5b86052fba0ce6a71302adb465c908: Status 404 returned error can't find the container with id 46d26ac9fd19a8af46c9f59fff075a059a5b86052fba0ce6a71302adb465c908 Jul 28 13:46:18.483697 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.483619 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:46:18.604751 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.604718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.604772 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.604905 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.604917 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.604934 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.604945 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:18.604980 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.604984 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:19.604966498 +0000 UTC m=+3.994937685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:18.605312 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.605004 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:19.604993802 +0000 UTC m=+3.994964994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:18.706204 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:18.706157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:18.706417 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.706353 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:18.706492 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:18.706432 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:19.706411145 +0000 UTC m=+4.096382333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:19.040363 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.040272 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:41:17 +0000 UTC" deadline="2027-12-30 04:18:20.495788603 +0000 UTC" Jul 28 13:46:19.040363 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.040336 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12470h32m1.455456109s" Jul 28 13:46:19.136902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.135899 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:19.136902 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.136033 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:19.148978 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.148886 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" event={"ID":"fd67f80e-75ae-4165-a681-77163d4f2249","Type":"ContainerStarted","Data":"1e6c41b8dba82d000b7db0a41e73e762e166e29eb59b7be9fda3e0f3f53a704c"} Jul 28 13:46:19.160409 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.160336 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncq86" event={"ID":"df346386-76f9-4bf2-ab1e-3941c73abeda","Type":"ContainerStarted","Data":"ef07c019f7279f44e7c31cf7cc180c791a1e09b0769a2be539f90215f6597208"} Jul 28 13:46:19.162166 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.162093 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4prm2" event={"ID":"e898eb0a-6831-4f1a-a2e2-b3017623fc39","Type":"ContainerStarted","Data":"a5863e9cd010934cd1575980f9799bfeb048c67bdecfc820bc62cb4e4025022d"} Jul 28 13:46:19.163540 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.163481 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9zpj" event={"ID":"0949ff00-521c-489c-a074-8893c4c1b993","Type":"ContainerStarted","Data":"46d26ac9fd19a8af46c9f59fff075a059a5b86052fba0ce6a71302adb465c908"} Jul 28 13:46:19.169977 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.169878 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerStarted","Data":"6dc50e56e21a5b24a86a52e9277ab9b4f0cbb83d5a03aaa7c3bae8ce3eb314a9"} Jul 28 13:46:19.174513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.174338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jkmrc" event={"ID":"5eae876f-cc9a-42a9-a66d-6fad0520fc77","Type":"ContainerStarted","Data":"edcc3bc2efaad47449242f763bfebfbe9e320f4193f6c815cf395ec636e2f691"} Jul 28 13:46:19.178491 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.178466 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"d3bf45e6bd43acaa06e725d016c67443850a52fbdf39df876e88e891a8a64302"} Jul 28 13:46:19.180612 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.180500 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sqj4g" event={"ID":"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f","Type":"ContainerStarted","Data":"909ec26f447a92bada411bac96b25cc8ed221eea5e8d9efafbc515e96067ceb4"} Jul 28 13:46:19.183726 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.183703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" event={"ID":"8373ee1d-2e45-4cc0-b58e-117849f3c24c","Type":"ContainerStarted","Data":"31d949a0aadc39664962c5b477994a761ab4292c4ba45425e36b46a750327a00"} Jul 28 13:46:19.617809 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.617775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:19.618024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.617869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:19.618115 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618027 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:19.618115 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618045 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:19.618115 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618059 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:19.618115 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:21.618093791 +0000 UTC m=+6.008064992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:19.618546 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618523 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:19.618682 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.618589 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:21.618571246 +0000 UTC m=+6.008542450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:19.719093 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:19.719055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:19.719251 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.719196 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:19.719294 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:19.719254 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:21.719235301 +0000 UTC m=+6.109206505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:20.136642 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:20.136609 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:20.137215 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:20.136749 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:20.137215 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:20.137152 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:20.137351 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:20.137244 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:20.200347 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:20.199669 2554 generic.go:356] "Generic (PLEG): container finished" podID="123569e86275469bca87afde54f1bea6" containerID="50122e5889f811fef05ab800e022cd77a9b045f6d2a717f1223459d116f8234d" exitCode=0 Jul 28 13:46:20.200347 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:20.199725 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"123569e86275469bca87afde54f1bea6","Type":"ContainerDied","Data":"50122e5889f811fef05ab800e022cd77a9b045f6d2a717f1223459d116f8234d"} Jul 28 13:46:21.135079 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.134732 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:21.135266 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.135113 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:21.218747 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.218703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" event={"ID":"123569e86275469bca87afde54f1bea6","Type":"ContainerStarted","Data":"2f406a28229c89774358bade48416c1197d803be1497a031d5eeb6d0f59c9c9d"} Jul 28 13:46:21.238217 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.237668 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-91.ec2.internal" podStartSLOduration=4.237644313 podStartE2EDuration="4.237644313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:21.236793303 +0000 UTC m=+5.626764514" watchObservedRunningTime="2026-07-28 13:46:21.237644313 +0000 UTC m=+5.627615526" Jul 28 13:46:21.636072 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.636024 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:21.636260 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.636084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:21.636260 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636251 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:21.636398 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636318 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:25.636297172 +0000 UTC m=+10.026268367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:21.636767 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636742 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:21.636884 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636773 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:21.636884 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636789 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:21.636884 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.636838 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:25.636820726 +0000 UTC m=+10.026791917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:21.737274 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:21.737156 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:21.737449 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.737324 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:21.737449 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:21.737398 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:25.737377726 +0000 UTC m=+10.127348930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:22.134962 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:22.134622 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:22.134962 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:22.134760 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:22.135345 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:22.135311 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:22.135470 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:22.135441 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:23.134780 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:23.134240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:23.134780 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:23.134377 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:24.134605 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:24.134567 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:24.134801 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:24.134714 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:24.134801 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:24.134772 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:24.135237 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:24.134889 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:25.134895 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:25.134383 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:25.134895 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.134521 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:25.671553 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:25.671504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:25.671744 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:25.671641 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:25.671830 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671796 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:25.671830 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671825 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:25.671943 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671830 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:25.671943 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671840 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:25.671943 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671905 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:33.671883409 +0000 UTC m=+18.061854612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:25.671943 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.671932 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:33.671920875 +0000 UTC m=+18.061892080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:25.772733 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:25.772693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:25.772936 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.772841 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:25.772936 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:25.772911 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:33.772891451 +0000 UTC m=+18.162862643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:26.134562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:26.134526 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:26.134737 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:26.134662 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:26.136050 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:26.136030 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:26.136507 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:26.136154 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:27.134771 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:27.134726 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:27.135035 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:27.134880 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:28.135576 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:28.134966 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:28.135576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:28.135136 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:28.135576 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:28.135499 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:28.136201 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:28.135617 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:29.134463 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:29.134430 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:29.134641 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:29.134556 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:30.135187 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:30.135155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:30.135513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:30.135155 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:30.135513 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:30.135284 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:30.135513 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:30.135317 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:31.134451 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:31.134418 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:31.134602 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:31.134540 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:32.135016 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:32.134911 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:32.135499 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:32.135071 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:32.135499 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:32.135123 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:32.135499 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:32.135215 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:33.134621 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:33.134586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:33.134847 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.134697 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:33.733438 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:33.733406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:33.733484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733568 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733593 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733606 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733617 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733636 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:46:49.733618684 +0000 UTC m=+34.123589872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:33.734037 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.733660 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:46:49.733647656 +0000 UTC m=+34.123618840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:33.834243 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:33.834214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:33.834415 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.834330 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:33.834415 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:33.834387 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:49.834371996 +0000 UTC m=+34.224343183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:34.134645 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:34.134613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:34.134824 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:34.134613 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:34.134824 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:34.134744 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:34.135002 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:34.134824 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:35.134653 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:35.134616 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:35.135101 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:35.134720 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:36.135735 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:36.135698 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:36.136191 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:36.135821 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:36.136191 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:36.135894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:36.136191 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:36.136044 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:37.134534 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:37.134493 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:37.134702 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:37.134627 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:38.135042 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:38.135001 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:38.135436 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:38.135001 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:38.135436 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:38.135122 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:38.135436 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:38.135231 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:39.135396 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.135121 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:39.136062 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:39.135462 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:39.270245 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.270183 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sqj4g" event={"ID":"6c4841ce-8f2c-43ac-a4fb-c3da29cd236f","Type":"ContainerStarted","Data":"b23610b420d66b12c8062ddcbf686a6d4612309741917b50f874782a5664bd6c"} Jul 28 13:46:39.273358 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.272513 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" event={"ID":"8373ee1d-2e45-4cc0-b58e-117849f3c24c","Type":"ContainerStarted","Data":"fd3bbafe4b3b551920a25c8078759e6bb461e6f2da7a5eb4c6292ceaeed6342c"} Jul 28 13:46:39.275103 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.275076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" event={"ID":"fd67f80e-75ae-4165-a681-77163d4f2249","Type":"ContainerStarted","Data":"2c304b5b3e6d5ffad5b0b89862825ecf848af816711ee3e838651df37e4d7bf6"} Jul 28 13:46:39.276584 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.276556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4prm2" event={"ID":"e898eb0a-6831-4f1a-a2e2-b3017623fc39","Type":"ContainerStarted","Data":"49caffc989798c73b63bb6d609acc3ba939ca4950aa88ee1ff40d36814d78259"} Jul 28 13:46:39.278173 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.278147 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9zpj" event={"ID":"0949ff00-521c-489c-a074-8893c4c1b993","Type":"ContainerStarted","Data":"0eea9e792f98d1572ca251f9bc2ad0be659f70ad2735ac593c9dfe9d642b7759"} Jul 28 13:46:39.279932 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.279910 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="1b19c5053613e8e600d1f6845996dee77fb7b680e1114d2c83e260b236ed4c6e" exitCode=0 Jul 28 13:46:39.280066 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.280000 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"1b19c5053613e8e600d1f6845996dee77fb7b680e1114d2c83e260b236ed4c6e"} Jul 28 13:46:39.281523 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.281500 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jkmrc" event={"ID":"5eae876f-cc9a-42a9-a66d-6fad0520fc77","Type":"ContainerStarted","Data":"cec4f9ee7420be55fcc5a6fb06434f6696cdef157a27319c61244a889fed1cb2"} Jul 28 13:46:39.283191 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.283171 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" event={"ID":"22e3722b3da67d4e99a57997b921b163","Type":"ContainerStarted","Data":"d61e1af6eb37f2178d2e794de28154d45902e21105b87aa9d4df31de63ced66c"} Jul 28 13:46:39.286134 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"e46883bf6c3d886efedcf0be99fe0654a3e3c8612fad0bc3f8528ed69defd9f3"} Jul 28 13:46:39.286240 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286173 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"aa94af723fe80694bcc34577fafb51049578a46711c7ab960f1155410c5b23d1"} Jul 28 13:46:39.286240 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286207 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"991dba5c679ea51696536465bed90967a858a6a1aa613017555b2bedb72a63c4"} Jul 28 13:46:39.286240 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286236 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"0f2bccf8c5f4d540b82fdc5e0ce3ea581feff7fee09223703ef01ecc6de3f5d6"} Jul 28 13:46:39.286367 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286271 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"6c7e004df391529161c022ce4aa28f0eceef3f26e81ade24754233c123c16c26"} Jul 28 13:46:39.286367 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.286310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"6a4e0c40e78195d7e8a0a26ba7d2d3cac4d3c87441383206a2f5204d583f4951"} Jul 28 13:46:39.293327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.293288 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sqj4g" podStartSLOduration=2.447429293 podStartE2EDuration="22.293277085s" totalImagesPullingTime="19.845847792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.292921493 +0000 UTC m=+23.682892698" watchObservedRunningTime="2026-07-28 13:46:39.293277085 +0000 UTC m=+23.683248291" Jul 28 13:46:39.349012 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.348952 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f9zpj" podStartSLOduration=2.51467702 podStartE2EDuration="22.348937711s" totalImagesPullingTime="19.834260691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.334766761 +0000 UTC m=+23.724737971" watchObservedRunningTime="2026-07-28 13:46:39.348937711 +0000 UTC m=+23.738908916" Jul 28 13:46:39.349118 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.349054 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-91.ec2.internal" podStartSLOduration=22.3490482 podStartE2EDuration="22.3490482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.348624776 +0000 UTC m=+23.738595983" watchObservedRunningTime="2026-07-28 13:46:39.3490482 +0000 UTC m=+23.739019406" Jul 28 13:46:39.382129 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.382084 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jkmrc" podStartSLOduration=2.505163948 podStartE2EDuration="22.382070003s" totalImagesPullingTime="19.876906055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.362947977 +0000 UTC m=+23.752919185" watchObservedRunningTime="2026-07-28 13:46:39.382070003 +0000 UTC m=+23.772041406" Jul 28 13:46:39.382269 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.382152 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4prm2" podStartSLOduration=2.446777581 podStartE2EDuration="22.382148913s" totalImagesPullingTime="19.935371332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.381884411 +0000 UTC m=+23.771855618" watchObservedRunningTime="2026-07-28 13:46:39.382148913 +0000 UTC m=+23.772120120" Jul 28 13:46:39.399220 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.399136 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dh8lm" podStartSLOduration=2.520400723 podStartE2EDuration="22.399122892s" totalImagesPullingTime="19.878722169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:39.398846829 +0000 UTC m=+23.788818037" watchObservedRunningTime="2026-07-28 13:46:39.399122892 +0000 UTC m=+23.789094096" Jul 28 13:46:39.981308 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:39.981271 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 13:46:40.134835 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.134757 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:40.135066 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:40.134904 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:40.135066 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.134939 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:40.135210 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:40.135168 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:40.194463 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.194339 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T13:46:39.98129092Z","UUID":"c123d10f-8774-4ad2-8ca5-e30383dc39d0","Handler":null,"Name":"","Endpoint":""} Jul 28 13:46:40.196024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.195965 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 13:46:40.196024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.196025 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 13:46:40.290680 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.290644 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" event={"ID":"fd67f80e-75ae-4165-a681-77163d4f2249","Type":"ContainerStarted","Data":"0139b7017e55f69929cea0dbfb42500b3ae5d22e45ac5fb6e7325edd4ab69cd0"} Jul 28 13:46:40.292183 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:40.292158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncq86" event={"ID":"df346386-76f9-4bf2-ab1e-3941c73abeda","Type":"ContainerStarted","Data":"08d0dd5077044d6df38895e882b525bd0f81aa205488beaf65b25ceb1dd73353"} Jul 28 13:46:41.135298 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:41.135083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:41.135514 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:41.135400 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:41.298855 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:41.298772 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"eb8d73bdd431f858edb0ad7c64285f99436a878a1d31fea4510cc369232e1aed"} Jul 28 13:46:41.301001 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:41.300963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" event={"ID":"fd67f80e-75ae-4165-a681-77163d4f2249","Type":"ContainerStarted","Data":"12eba2112074c76c14234dcefebb34fc967b109a5dd0d374f711e8b671fd4b33"} Jul 28 13:46:42.109891 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.109861 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:42.110482 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.110459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:42.132650 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.132610 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ncq86" podStartSLOduration=5.272638388 podStartE2EDuration="25.132597991s" totalImagesPullingTime="19.859959603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:40.309551905 +0000 UTC m=+24.699523121" watchObservedRunningTime="2026-07-28 13:46:42.132597991 +0000 UTC m=+26.522569196" Jul 28 13:46:42.134679 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.134654 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:42.134803 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:42.134776 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:42.134867 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.134831 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:42.134949 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:42.134928 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:42.322070 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:42.322011 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lnmk" podStartSLOduration=2.845448375 podStartE2EDuration="25.321991701s" totalImagesPullingTime="22.476543326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:42.321788166 +0000 UTC m=+26.711759371" watchObservedRunningTime="2026-07-28 13:46:42.321991701 +0000 UTC m=+26.711962909" Jul 28 13:46:43.135094 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.135056 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:43.135246 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:43.135187 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:43.309872 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.309514 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" event={"ID":"8a6f00e0-9a1c-4aea-9eec-8e8204ec2856","Type":"ContainerStarted","Data":"2909ba5823e0be9f13713f8bab07aa406043b77df13da7c367621d0a07ceb94e"} Jul 28 13:46:43.310572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.309946 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:43.310572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.310037 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:43.310572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.310092 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:43.326273 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.326151 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:43.331587 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.331489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:46:43.340368 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:43.340308 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" podStartSLOduration=6.435291975 podStartE2EDuration="26.340288714s" totalImagesPullingTime="19.904996739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:43.339165698 +0000 UTC m=+27.729136921" watchObservedRunningTime="2026-07-28 13:46:43.340288714 +0000 UTC m=+27.730259930" Jul 28 13:46:44.134485 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:44.134321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:44.134631 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:44.134322 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:44.134631 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:44.134568 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:44.134703 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:44.134628 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:44.312748 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:44.312719 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="9317bff602fbf37444d9bc729b1546be22461b8d622f806056f5217de81464a3" exitCode=0 Jul 28 13:46:44.312916 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:44.312805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"9317bff602fbf37444d9bc729b1546be22461b8d622f806056f5217de81464a3"} Jul 28 13:46:45.134511 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.134483 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:45.134888 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:45.134581 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:45.263671 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.263272 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2w4qv"] Jul 28 13:46:45.263671 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.263565 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:45.263804 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:45.263670 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:45.264188 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.264093 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xbjrs"] Jul 28 13:46:45.264694 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.264674 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n5546"] Jul 28 13:46:45.264795 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.264775 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:45.264903 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:45.264878 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:45.314783 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:45.314761 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:45.314924 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:45.314855 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:46.319313 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:46.319277 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="b5bf57714394e5fe0a1154308a8d4471201af1b36e1bafd6933100689f5a1e09" exitCode=0 Jul 28 13:46:46.319862 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:46.319315 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"b5bf57714394e5fe0a1154308a8d4471201af1b36e1bafd6933100689f5a1e09"} Jul 28 13:46:47.135008 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.134961 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:47.135204 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.135015 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:47.135204 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:47.135112 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:47.135317 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.135291 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:47.135423 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:47.135396 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:47.135499 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:47.135481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:47.397917 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.397847 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:47.398406 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.398015 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:46:47.398550 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:47.398525 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f9zpj" Jul 28 13:46:48.325704 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:48.325673 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="a49f3b55844ee22828de6fa887fa1f5e7bf07a2d2938d180d321cd19c306604f" exitCode=0 Jul 28 13:46:48.325888 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:48.325751 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"a49f3b55844ee22828de6fa887fa1f5e7bf07a2d2938d180d321cd19c306604f"} Jul 28 13:46:49.134571 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.134532 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:49.134571 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.134567 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:49.135361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.134546 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:49.135361 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.134664 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xbjrs" podUID="ad9408d2-46a8-4b0b-812b-14a220b8c26d" Jul 28 13:46:49.135361 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.134715 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2w4qv" podUID="21382e6a-33e2-412a-9f0e-996c44b89351" Jul 28 13:46:49.135361 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.134791 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n5546" podUID="8fb47319-a07f-41ae-b273-5e100eed0f4f" Jul 28 13:46:49.753361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.753321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:49.753361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.753361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753461 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753476 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753490 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753501 2554 projected.go:196] Error preparing data for projected volume kube-api-access-tfzqm for pod openshift-network-diagnostics/network-check-target-xbjrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753525 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs podName:8fb47319-a07f-41ae-b273-5e100eed0f4f nodeName:}" failed. No retries permitted until 2026-07-28 13:47:21.753507116 +0000 UTC m=+66.143478304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs") pod "network-metrics-daemon-n5546" (UID: "8fb47319-a07f-41ae-b273-5e100eed0f4f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:46:49.753576 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.753541 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm podName:ad9408d2-46a8-4b0b-812b-14a220b8c26d nodeName:}" failed. No retries permitted until 2026-07-28 13:47:21.75353432 +0000 UTC m=+66.143505505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfzqm" (UniqueName: "kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm") pod "network-check-target-xbjrs" (UID: "ad9408d2-46a8-4b0b-812b-14a220b8c26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:46:49.854337 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:49.854305 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:49.854522 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.854478 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:49.854584 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:49.854565 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret podName:21382e6a-33e2-412a-9f0e-996c44b89351 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:21.854532896 +0000 UTC m=+66.244504096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret") pod "global-pull-secret-syncer-2w4qv" (UID: "21382e6a-33e2-412a-9f0e-996c44b89351") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:46:50.914398 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.914216 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-91.ec2.internal" event="NodeReady" Jul 28 13:46:50.914814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.914479 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 13:46:50.972023 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.971940 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ld4m9"] Jul 28 13:46:50.973930 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.973907 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8pt4s"] Jul 28 13:46:50.974126 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.974052 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:50.975895 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.975876 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:50.976941 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.976921 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l8nws\"" Jul 28 13:46:50.977109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.977058 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 13:46:50.977358 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.977175 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 13:46:50.978813 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.978713 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 13:46:50.978813 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.978725 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 13:46:50.978968 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.978834 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 13:46:50.979192 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.979174 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x6gdw\"" Jul 28 13:46:50.988399 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.988059 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pt4s"] Jul 28 13:46:50.989348 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:50.989324 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ld4m9"] Jul 28 13:46:51.063277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.063253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgr65\" (UniqueName: \"kubernetes.io/projected/76d03a97-ae81-4f43-8587-e8f185ab2a41-kube-api-access-wgr65\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.063399 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.063305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.063399 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.063335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03a97-ae81-4f43-8587-e8f185ab2a41-tmp-dir\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.063399 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.063370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/76d03a97-ae81-4f43-8587-e8f185ab2a41-config-volume\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.134954 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.134925 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:46:51.135090 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.134965 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:46:51.135090 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.135055 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:46:51.138044 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138023 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26q9h\"" Jul 28 13:46:51.138145 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138060 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:46:51.138237 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138221 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:46:51.138300 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138287 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:46:51.138352 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138300 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw72x\"" Jul 28 13:46:51.138441 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.138426 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:46:51.164505 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03a97-ae81-4f43-8587-e8f185ab2a41-tmp-dir\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.164573 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/76d03a97-ae81-4f43-8587-e8f185ab2a41-config-volume\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.164573 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164544 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45f38503-dc90-4dde-ad36-c07e7894a3a2-cert\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.164573 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164562 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pvf\" (UniqueName: \"kubernetes.io/projected/45f38503-dc90-4dde-ad36-c07e7894a3a2-kube-api-access-s5pvf\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.164727 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgr65\" (UniqueName: \"kubernetes.io/projected/76d03a97-ae81-4f43-8587-e8f185ab2a41-kube-api-access-wgr65\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.164778 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.164828 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:51.164805 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:46:51.164828 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.164818 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76d03a97-ae81-4f43-8587-e8f185ab2a41-tmp-dir\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.164910 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:51.164867 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:51.664841538 +0000 UTC m=+36.054812731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:46:51.165033 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.165019 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/76d03a97-ae81-4f43-8587-e8f185ab2a41-config-volume\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.177185 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.177167 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgr65\" (UniqueName: \"kubernetes.io/projected/76d03a97-ae81-4f43-8587-e8f185ab2a41-kube-api-access-wgr65\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.266016 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.265891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45f38503-dc90-4dde-ad36-c07e7894a3a2-cert\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.266016 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.265927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pvf\" (UniqueName: \"kubernetes.io/projected/45f38503-dc90-4dde-ad36-c07e7894a3a2-kube-api-access-s5pvf\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.268546 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.268525 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45f38503-dc90-4dde-ad36-c07e7894a3a2-cert\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.275443 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.275402 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pvf\" (UniqueName: \"kubernetes.io/projected/45f38503-dc90-4dde-ad36-c07e7894a3a2-kube-api-access-s5pvf\") pod \"ingress-canary-8pt4s\" (UID: \"45f38503-dc90-4dde-ad36-c07e7894a3a2\") " pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.293434 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.293415 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8pt4s" Jul 28 13:46:51.442277 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.442248 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8pt4s"] Jul 28 13:46:51.447231 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:51.447202 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f38503_dc90_4dde_ad36_c07e7894a3a2.slice/crio-5e400fa384619751f3c06ea81012d7d10e4b9052d25905c46cc0619476d027b7 WatchSource:0}: Error finding container 5e400fa384619751f3c06ea81012d7d10e4b9052d25905c46cc0619476d027b7: Status 404 returned error can't find the container with id 5e400fa384619751f3c06ea81012d7d10e4b9052d25905c46cc0619476d027b7 Jul 28 13:46:51.668745 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:51.668709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:51.668906 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:51.668842 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:46:51.668906 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:51.668901 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:52.668885027 +0000 UTC m=+37.058856212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:46:52.338042 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.337995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pt4s" event={"ID":"45f38503-dc90-4dde-ad36-c07e7894a3a2","Type":"ContainerStarted","Data":"5e400fa384619751f3c06ea81012d7d10e4b9052d25905c46cc0619476d027b7"} Jul 28 13:46:52.472854 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.472819 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv"] Jul 28 13:46:52.475493 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.475458 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk"] Jul 28 13:46:52.475621 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.475602 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" Jul 28 13:46:52.478990 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.478949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j259f\"" Jul 28 13:46:52.479290 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.479271 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.480070 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.480050 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-lpjgw"] Jul 28 13:46:52.483156 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.483135 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v"] Jul 28 13:46:52.483273 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.483241 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.484706 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.484688 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:46:52.484874 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.484756 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.485814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.485637 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 13:46:52.485814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.485688 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.485814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.485733 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rglzb\"" Jul 28 13:46:52.485814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.485774 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 13:46:52.486086 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.486059 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 13:46:52.486086 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.486055 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.486213 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.486062 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.486213 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.486185 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8249t\"" Jul 28 13:46:52.486791 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.486774 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.487060 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.487041 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.487513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.487496 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 13:46:52.488105 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.488087 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.488537 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.488498 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 13:46:52.488799 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.488777 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vl97s\"" Jul 28 13:46:52.490219 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.490089 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv"] Jul 28 13:46:52.492992 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.492949 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk"] Jul 28 13:46:52.493598 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.493573 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v"] Jul 28 13:46:52.495253 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.495228 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:46:52.495649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.495566 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.495649 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.495574 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 13:46:52.502444 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.502425 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8pkhn\"" Jul 28 13:46:52.502572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.502544 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 13:46:52.502818 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.502442 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 13:46:52.502818 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.502438 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 13:46:52.503833 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.503662 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 13:46:52.519938 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.519904 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-lpjgw"] Jul 28 13:46:52.572882 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.572856 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9"] Jul 28 13:46:52.575081 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" Jul 28 13:46:52.575870 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575850 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.575999 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d97v4\" (UniqueName: \"kubernetes.io/projected/775472de-5e74-494c-9c33-e9d50daf0cda-kube-api-access-d97v4\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.575999 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575890 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.575999 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575935 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-snapshots\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.575999 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.575965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-tmp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.576178 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.576008 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/923f5579-8b90-4574-8edc-52e337261140-serving-cert\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.576178 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.576076 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-service-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.576178 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.576120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpzp\" (UniqueName: \"kubernetes.io/projected/923f5579-8b90-4574-8edc-52e337261140-kube-api-access-jhpzp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.576292 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.576213 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6ss\" (UniqueName: \"kubernetes.io/projected/41c88b10-3a3a-40c3-a011-76801745eeca-kube-api-access-sx6ss\") pod \"network-check-source-7d88cb55d8-rp8sv\" (UID: \"41c88b10-3a3a-40c3-a011-76801745eeca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" Jul 28 13:46:52.578210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.578188 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.578317 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.578221 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.578375 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.578310 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-78h9x\"" Jul 28 13:46:52.582836 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.582128 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9"] Jul 28 13:46:52.586257 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.586208 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kj86r"] Jul 28 13:46:52.586358 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.586334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.589726 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.589287 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 13:46:52.589726 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.589661 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m56x8\"" Jul 28 13:46:52.590406 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.590384 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4"] Jul 28 13:46:52.590574 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.590553 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.590761 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.590618 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.590881 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.590635 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 13:46:52.591480 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.590660 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.593959 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.593940 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-866dc68ffc-g4w7d"] Jul 28 13:46:52.594095 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.594078 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.596133 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.596116 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9"] Jul 28 13:46:52.596249 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.596233 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.597679 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.597663 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 13:46:52.597776 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.597673 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.600577 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.600558 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9"] Jul 28 13:46:52.601132 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.601116 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 13:46:52.601482 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.601463 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.602270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.602251 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9c65k\"" Jul 28 13:46:52.602350 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.602317 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 13:46:52.602536 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.602519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lv685\"" Jul 28 13:46:52.602855 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.602756 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.604041 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.604021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 13:46:52.604141 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.604080 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.604141 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.604027 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 13:46:52.606067 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.606044 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 13:46:52.606539 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.606521 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 13:46:52.606878 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.606860 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 13:46:52.607164 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.607146 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 13:46:52.607294 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.607274 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tzxlw\"" Jul 28 13:46:52.608627 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.608609 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 13:46:52.608905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.608886 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 13:46:52.617001 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.616963 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-866dc68ffc-g4w7d"] Jul 28 13:46:52.617652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.617633 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4"] Jul 28 13:46:52.626514 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.626497 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kj86r"] Jul 28 13:46:52.676838 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-service-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.676961 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.676961 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-config\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.676961 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.676961 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.676969 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677007 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d97v4\" (UniqueName: \"kubernetes.io/projected/775472de-5e74-494c-9c33-e9d50daf0cda-kube-api-access-d97v4\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677023 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-kube-api-access-85qqg\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677054 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677078 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677103 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677138 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpzp\" (UniqueName: \"kubernetes.io/projected/923f5579-8b90-4574-8edc-52e337261140-kube-api-access-jhpzp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.677150 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 13:46:52.677184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677164 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677189 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.677211 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls podName:775472de-5e74-494c-9c33-e9d50daf0cda nodeName:}" failed. No retries permitted until 2026-07-28 13:46:53.177192229 +0000 UTC m=+37.567163414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls") pod "cluster-samples-operator-6748489656-8b4pk" (UID: "775472de-5e74-494c-9c33-e9d50daf0cda") : secret "samples-operator-tls" not found Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6ss\" (UniqueName: \"kubernetes.io/projected/41c88b10-3a3a-40c3-a011-76801745eeca-kube-api-access-sx6ss\") pod \"network-check-source-7d88cb55d8-rp8sv\" (UID: \"41c88b10-3a3a-40c3-a011-76801745eeca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677309 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.677394 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkpkk\" (UniqueName: \"kubernetes.io/projected/de2e5964-10cc-4568-a249-12c857ccabbb-kube-api-access-vkpkk\") pod \"volume-data-source-validator-549c6d54cf-2mzg9\" (UID: \"de2e5964-10cc-4568-a249-12c857ccabbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677419 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-service-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2xb4\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.677451 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.677435628 +0000 UTC m=+39.067406819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-snapshots\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-tmp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.677582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.677593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/923f5579-8b90-4574-8edc-52e337261140-serving-cert\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.678217 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.678198 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-snapshots\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.678280 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.678216 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/923f5579-8b90-4574-8edc-52e337261140-tmp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.678337 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.678318 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/923f5579-8b90-4574-8edc-52e337261140-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.681242 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.681205 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/923f5579-8b90-4574-8edc-52e337261140-serving-cert\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.686242 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.686219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpzp\" (UniqueName: \"kubernetes.io/projected/923f5579-8b90-4574-8edc-52e337261140-kube-api-access-jhpzp\") pod \"insights-operator-5885fdb759-lpjgw\" (UID: \"923f5579-8b90-4574-8edc-52e337261140\") " pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.689224 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.689199 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6ss\" (UniqueName: \"kubernetes.io/projected/41c88b10-3a3a-40c3-a011-76801745eeca-kube-api-access-sx6ss\") pod \"network-check-source-7d88cb55d8-rp8sv\" (UID: \"41c88b10-3a3a-40c3-a011-76801745eeca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" Jul 28 13:46:52.689532 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.689512 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d97v4\" (UniqueName: \"kubernetes.io/projected/775472de-5e74-494c-9c33-e9d50daf0cda-kube-api-access-d97v4\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:52.778413 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.778413 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778415 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r2wp\" (UniqueName: \"kubernetes.io/projected/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-kube-api-access-5r2wp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-trusted-ca\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkpkk\" (UniqueName: \"kubernetes.io/projected/de2e5964-10cc-4568-a249-12c857ccabbb-kube-api-access-vkpkk\") pod \"volume-data-source-validator-549c6d54cf-2mzg9\" (UID: \"de2e5964-10cc-4568-a249-12c857ccabbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bwh\" (UniqueName: \"kubernetes.io/projected/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-kube-api-access-86bwh\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2xb4\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778586 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.778632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778623 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-serving-cert\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778713 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-config\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7t8\" (UniqueName: \"kubernetes.io/projected/9bdc4799-efa6-4173-b9cd-31f86f5daa89-kube-api-access-ls7t8\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778833 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-default-certificate\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.778905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778865 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778944 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.778986 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-kube-api-access-85qqg\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779049 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6q4j\" (UniqueName: \"kubernetes.io/projected/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-kube-api-access-f6q4j\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779126 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-config\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-stats-auth\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779242 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.779327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.779856 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.779378 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:46:52.779856 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779379 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-config\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.779856 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.779391 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:46:52.779856 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.779444 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:53.279427058 +0000 UTC m=+37.669398243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:46:52.780078 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.779868 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.780315 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.780297 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.780527 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.780506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.781296 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.781269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.781476 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.781451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.781966 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.781943 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-serving-cert\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.805242 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.790563 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkpkk\" (UniqueName: \"kubernetes.io/projected/de2e5964-10cc-4568-a249-12c857ccabbb-kube-api-access-vkpkk\") pod \"volume-data-source-validator-549c6d54cf-2mzg9\" (UID: \"de2e5964-10cc-4568-a249-12c857ccabbb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" Jul 28 13:46:52.805242 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.792598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/37ebe66f-7da1-4537-9baa-64fa1f7e06e1-kube-api-access-85qqg\") pod \"service-ca-operator-5d6c75f84f-fr52v\" (UID: \"37ebe66f-7da1-4537-9baa-64fa1f7e06e1\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.805242 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.805060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" Jul 28 13:46:52.809475 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.809452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" Jul 28 13:46:52.811456 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.811434 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2xb4\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.812408 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.811734 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:52.816383 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.816363 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" Jul 28 13:46:52.880354 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-config\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.880354 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880320 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-stats-auth\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.880354 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.880595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.880595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r2wp\" (UniqueName: \"kubernetes.io/projected/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-kube-api-access-5r2wp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.880595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880432 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-trusted-ca\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.880595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bwh\" (UniqueName: \"kubernetes.io/projected/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-kube-api-access-86bwh\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.880811 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.880811 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880710 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-serving-cert\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.880811 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.880811 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.880802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7t8\" (UniqueName: \"kubernetes.io/projected/9bdc4799-efa6-4173-b9cd-31f86f5daa89-kube-api-access-ls7t8\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.881107 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881083 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-config\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.881168 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.881152 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:53.381132091 +0000 UTC m=+37.771103282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:46:52.881230 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881183 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.881286 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881258 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-trusted-ca\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.881346 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-default-certificate\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.881346 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.881446 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.881446 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.881425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6q4j\" (UniqueName: \"kubernetes.io/projected/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-kube-api-access-f6q4j\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.882667 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.882147 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:46:52.882667 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.882217 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:53.382199835 +0000 UTC m=+37.772171023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:46:52.882667 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.882459 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:52.882667 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:52.882513 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:53.382499066 +0000 UTC m=+37.772470251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:52.882931 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.882762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.888109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.883365 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-serving-cert\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.888109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.883415 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.888109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.883592 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-stats-auth\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.888109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.886043 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" Jul 28 13:46:52.889163 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.889140 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-default-certificate\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.891421 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.891390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bwh\" (UniqueName: \"kubernetes.io/projected/e15d794e-19a1-4f0e-8f0a-df7b37cdd634-kube-api-access-86bwh\") pod \"console-operator-584dcb6b54-kj86r\" (UID: \"e15d794e-19a1-4f0e-8f0a-df7b37cdd634\") " pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:52.891605 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.891584 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7t8\" (UniqueName: \"kubernetes.io/projected/9bdc4799-efa6-4173-b9cd-31f86f5daa89-kube-api-access-ls7t8\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:52.891671 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.891637 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r2wp\" (UniqueName: \"kubernetes.io/projected/8b49ce45-fbb5-4e4d-bcc0-ba58042d580d-kube-api-access-5r2wp\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9\" (UID: \"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.892008 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.891991 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6q4j\" (UniqueName: \"kubernetes.io/projected/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-kube-api-access-f6q4j\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:52.899078 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.899060 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" Jul 28 13:46:52.906875 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:52.906856 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:46:53.184625 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.184544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:53.184771 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.184725 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 13:46:53.184834 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.184803 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls podName:775472de-5e74-494c-9c33-e9d50daf0cda nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.184787644 +0000 UTC m=+38.574758829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls") pod "cluster-samples-operator-6748489656-8b4pk" (UID: "775472de-5e74-494c-9c33-e9d50daf0cda") : secret "samples-operator-tls" not found Jul 28 13:46:53.287039 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.286341 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:53.287039 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.286764 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:46:53.287039 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.286783 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:46:53.287039 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.286855 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.286833863 +0000 UTC m=+38.676805065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:46:53.389564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.388705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:53.389564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.388866 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:53.389564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.388925 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:53.389564 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.389084 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:46:53.389564 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.389152 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.389125846 +0000 UTC m=+38.779097047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:46:53.390808 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.390193 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:53.390808 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.390252 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.390235543 +0000 UTC m=+38.780206745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:53.390808 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:53.390297 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:54.390273562 +0000 UTC m=+38.780244754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:46:53.455061 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.454626 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v"] Jul 28 13:46:53.459049 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.458821 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-lpjgw"] Jul 28 13:46:53.461714 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.461642 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9"] Jul 28 13:46:53.463254 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.463015 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9"] Jul 28 13:46:53.468055 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:53.468029 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod923f5579_8b90_4574_8edc_52e337261140.slice/crio-f8613afbaa8cf0572b92e1b4fd8c4ce50975f5eed4348d49e3bffb55138e61f9 WatchSource:0}: Error finding container f8613afbaa8cf0572b92e1b4fd8c4ce50975f5eed4348d49e3bffb55138e61f9: Status 404 returned error can't find the container with id f8613afbaa8cf0572b92e1b4fd8c4ce50975f5eed4348d49e3bffb55138e61f9 Jul 28 13:46:53.468737 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:53.468716 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2e5964_10cc_4568_a249_12c857ccabbb.slice/crio-d063802998e2dcf849d758d3bc0444bdb21b14e8e4e14371b1c940d6d4fa9fff WatchSource:0}: Error finding container d063802998e2dcf849d758d3bc0444bdb21b14e8e4e14371b1c940d6d4fa9fff: Status 404 returned error can't find the container with id d063802998e2dcf849d758d3bc0444bdb21b14e8e4e14371b1c940d6d4fa9fff Jul 28 13:46:53.469837 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:53.469633 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b49ce45_fbb5_4e4d_bcc0_ba58042d580d.slice/crio-73e9ce20a15e26661346db3ec258bd7467fcc646577b6e597fb6df8c094bae6b WatchSource:0}: Error finding container 73e9ce20a15e26661346db3ec258bd7467fcc646577b6e597fb6df8c094bae6b: Status 404 returned error can't find the container with id 73e9ce20a15e26661346db3ec258bd7467fcc646577b6e597fb6df8c094bae6b Jul 28 13:46:53.480553 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.480502 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-kj86r"] Jul 28 13:46:53.482773 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:53.482722 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv"] Jul 28 13:46:53.486786 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:53.486558 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c88b10_3a3a_40c3_a011_76801745eeca.slice/crio-d3b68bb1c62aa6745b29557271de1ebf869965a819381106cc05908f589e4ef0 WatchSource:0}: Error finding container d3b68bb1c62aa6745b29557271de1ebf869965a819381106cc05908f589e4ef0: Status 404 returned error can't find the container with id d3b68bb1c62aa6745b29557271de1ebf869965a819381106cc05908f589e4ef0 Jul 28 13:46:53.487435 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:46:53.487414 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15d794e_19a1_4f0e_8f0a_df7b37cdd634.slice/crio-118cdff692264da5d8b76223f632d10c7946a989c7532c970959ab067bf4bd58 WatchSource:0}: Error finding container 118cdff692264da5d8b76223f632d10c7946a989c7532c970959ab067bf4bd58: Status 404 returned error can't find the container with id 118cdff692264da5d8b76223f632d10c7946a989c7532c970959ab067bf4bd58 Jul 28 13:46:54.196480 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.196352 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:54.197144 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.196773 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 13:46:54.197668 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.197598 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls podName:775472de-5e74-494c-9c33-e9d50daf0cda nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.197108801 +0000 UTC m=+40.587079990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls") pod "cluster-samples-operator-6748489656-8b4pk" (UID: "775472de-5e74-494c-9c33-e9d50daf0cda") : secret "samples-operator-tls" not found Jul 28 13:46:54.300008 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.299330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:54.300008 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.299578 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:46:54.300008 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.299595 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:46:54.300008 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.299652 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.299634294 +0000 UTC m=+40.689605479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:46:54.353575 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.353538 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" event={"ID":"e15d794e-19a1-4f0e-8f0a-df7b37cdd634","Type":"ContainerStarted","Data":"118cdff692264da5d8b76223f632d10c7946a989c7532c970959ab067bf4bd58"} Jul 28 13:46:54.355155 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.355130 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" event={"ID":"37ebe66f-7da1-4537-9baa-64fa1f7e06e1","Type":"ContainerStarted","Data":"54c5ef596d54cf77b635e5ba407d140ef4cf77f6cc85bdc3c697159638bc1be1"} Jul 28 13:46:54.356578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.356555 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" event={"ID":"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d","Type":"ContainerStarted","Data":"73e9ce20a15e26661346db3ec258bd7467fcc646577b6e597fb6df8c094bae6b"} Jul 28 13:46:54.358096 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.358048 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" event={"ID":"41c88b10-3a3a-40c3-a011-76801745eeca","Type":"ContainerStarted","Data":"d3b68bb1c62aa6745b29557271de1ebf869965a819381106cc05908f589e4ef0"} Jul 28 13:46:54.360226 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.360168 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" event={"ID":"923f5579-8b90-4574-8edc-52e337261140","Type":"ContainerStarted","Data":"f8613afbaa8cf0572b92e1b4fd8c4ce50975f5eed4348d49e3bffb55138e61f9"} Jul 28 13:46:54.369244 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.368390 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="052988c36c22a9cf4ceecf453e908b7ee06c8cfcf980eb567739a46040eb4e0b" exitCode=0 Jul 28 13:46:54.369244 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.368454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"052988c36c22a9cf4ceecf453e908b7ee06c8cfcf980eb567739a46040eb4e0b"} Jul 28 13:46:54.374057 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.373668 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" event={"ID":"de2e5964-10cc-4568-a249-12c857ccabbb","Type":"ContainerStarted","Data":"d063802998e2dcf849d758d3bc0444bdb21b14e8e4e14371b1c940d6d4fa9fff"} Jul 28 13:46:54.399914 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.399889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:54.400506 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.400030 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.400010829 +0000 UTC m=+40.789982030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:46:54.400506 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.400318 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:54.400506 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.400375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:54.400506 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.400445 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:54.400506 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.400492 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.400477961 +0000 UTC m=+40.790449147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:54.400756 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.400581 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:46:54.400756 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.400625 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.400613929 +0000 UTC m=+40.790585118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:46:54.708622 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:54.708540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:54.708856 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.708835 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:46:54.708942 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:54.708912 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:58.708884679 +0000 UTC m=+43.098855864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:46:55.386463 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.385195 2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb490d4-9ef9-4952-9fc6-2b25ed3403ba" containerID="f1b52e914b0ef7701fd2f2fb2b900d52afddc3f4f3ec3c44ddd87db6f0057bfe" exitCode=0 Jul 28 13:46:55.386463 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.386358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerDied","Data":"f1b52e914b0ef7701fd2f2fb2b900d52afddc3f4f3ec3c44ddd87db6f0057bfe"} Jul 28 13:46:55.427018 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.425882 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lptr4"] Jul 28 13:46:55.433830 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.431118 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:55.433830 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.433718 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 13:46:55.434567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.434064 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 13:46:55.434567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.434295 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5f8gh\"" Jul 28 13:46:55.441339 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.440357 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lptr4"] Jul 28 13:46:55.517180 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.517149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:55.517351 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.517266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bde103d-5ef7-4369-beec-6b0a5f769ce0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:55.617812 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.617718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bde103d-5ef7-4369-beec-6b0a5f769ce0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:55.617958 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.617918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:55.618393 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:55.618093 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:46:55.618393 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:55.618160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:56.118141468 +0000 UTC m=+40.508112655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:46:55.618846 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:55.618817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bde103d-5ef7-4369-beec-6b0a5f769ce0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:56.123513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.123488 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:56.123645 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.123629 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:46:56.123696 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.123687 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:57.123672058 +0000 UTC m=+41.513643243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:46:56.224022 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.223989 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:46:56.224210 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.224072 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 13:46:56.224210 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.224134 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls podName:775472de-5e74-494c-9c33-e9d50daf0cda nodeName:}" failed. No retries permitted until 2026-07-28 13:47:00.224114029 +0000 UTC m=+44.614085215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls") pod "cluster-samples-operator-6748489656-8b4pk" (UID: "775472de-5e74-494c-9c33-e9d50daf0cda") : secret "samples-operator-tls" not found Jul 28 13:46:56.325361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.325326 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:46:56.325544 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.325486 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:46:56.325544 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.325508 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:46:56.325651 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.325571 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:00.325552582 +0000 UTC m=+44.715523766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:46:56.426590 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.426548 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:56.426774 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.426628 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:46:56.426774 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.426688 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:00.426667818 +0000 UTC m=+44.816639004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:46:56.426774 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:56.426714 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:46:56.426774 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.426739 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:56.426774 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.426776 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:00.426765203 +0000 UTC m=+44.816736392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:46:56.427007 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.426814 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:46:56.427007 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:56.426845 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:00.426835202 +0000 UTC m=+44.816806393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:46:57.132386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:57.132350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:57.132590 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:57.132456 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:46:57.132590 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:57.132524 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:46:59.132504251 +0000 UTC m=+43.522475448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:46:58.744790 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:58.744704 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:46:58.745235 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:58.744845 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:46:58.745235 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:58.744915 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:06.744898338 +0000 UTC m=+51.134869536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:46:59.148615 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:46:59.148573 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:46:59.148782 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:59.148737 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:46:59.148828 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:46:59.148805 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:03.14878967 +0000 UTC m=+47.538760858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:47:00.256845 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:00.256763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:47:00.257220 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.256913 2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 13:47:00.257220 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.257000 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls podName:775472de-5e74-494c-9c33-e9d50daf0cda nodeName:}" failed. No retries permitted until 2026-07-28 13:47:08.256980166 +0000 UTC m=+52.646951362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls") pod "cluster-samples-operator-6748489656-8b4pk" (UID: "775472de-5e74-494c-9c33-e9d50daf0cda") : secret "samples-operator-tls" not found Jul 28 13:47:00.357738 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:00.357702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:00.357954 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.357866 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:47:00.357954 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.357882 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:47:00.357954 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.357943 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:08.357925925 +0000 UTC m=+52.747897113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:47:00.458459 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:00.458417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:47:00.458565 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:00.458490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:00.458623 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:00.458591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:00.458685 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.458592 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:47:00.458685 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.458669 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:47:00.458770 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.458692 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:08.458672546 +0000 UTC m=+52.848643738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:47:00.458770 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.458728 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:08.458707151 +0000 UTC m=+52.848678336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:47:00.458770 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:00.458746 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:08.458737088 +0000 UTC m=+52.848708276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:47:01.404103 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.404068 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/0.log" Jul 28 13:47:01.404581 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.404117 2554 generic.go:356] "Generic (PLEG): container finished" podID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" containerID="6aeb9caee8af08983e99613689ef75517d6c001e14dde4a4c122dfef28fd3974" exitCode=255 Jul 28 13:47:01.404581 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.404199 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" event={"ID":"e15d794e-19a1-4f0e-8f0a-df7b37cdd634","Type":"ContainerDied","Data":"6aeb9caee8af08983e99613689ef75517d6c001e14dde4a4c122dfef28fd3974"} Jul 28 13:47:01.404718 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.404702 2554 scope.go:117] "RemoveContainer" containerID="6aeb9caee8af08983e99613689ef75517d6c001e14dde4a4c122dfef28fd3974" Jul 28 13:47:01.406049 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.405997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" event={"ID":"37ebe66f-7da1-4537-9baa-64fa1f7e06e1","Type":"ContainerStarted","Data":"683a2495121e8fa72e3efaa4193e9e1946c2a2c9a57c605e7bc943d11dc1d3fb"} Jul 28 13:47:01.407896 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.407874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" event={"ID":"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d","Type":"ContainerStarted","Data":"86e9e63fe94a3905c0044a5b0a51133c8c85d97cf3cdcf7df487ccc384868980"} Jul 28 13:47:01.409574 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.409534 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" event={"ID":"41c88b10-3a3a-40c3-a011-76801745eeca","Type":"ContainerStarted","Data":"235395b9f649cadadc4cd293591001d53cee3ba66aa54d458b8b988b85c60bf5"} Jul 28 13:47:01.411319 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.411298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" event={"ID":"923f5579-8b90-4574-8edc-52e337261140","Type":"ContainerStarted","Data":"122c919f913c2b61108c71b8b3b4a11b5965182ad2f89c5167fae9b4e00b41a6"} Jul 28 13:47:01.414936 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.414915 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" event={"ID":"0cb490d4-9ef9-4952-9fc6-2b25ed3403ba","Type":"ContainerStarted","Data":"85980fb5295a40f7e5013465d5cb68ddae4b95be7559c2624c59c6df785adf66"} Jul 28 13:47:01.416421 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.416399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" event={"ID":"de2e5964-10cc-4568-a249-12c857ccabbb","Type":"ContainerStarted","Data":"f73f22ecc6784e13e0ed5625b93b74aa5b9a7e656cc37b2748b4b18cf127bb1d"} Jul 28 13:47:01.418499 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.418078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8pt4s" event={"ID":"45f38503-dc90-4dde-ad36-c07e7894a3a2","Type":"ContainerStarted","Data":"7d44788a0a1654134bdddce905445ea81c6d0911c067026900b9a27122998759"} Jul 28 13:47:01.449100 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.449059 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4pm8w" podStartSLOduration=13.324112802 podStartE2EDuration="44.449046329s" totalImagesPullingTime="31.124933527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.447258631 +0000 UTC m=+45.837229838" watchObservedRunningTime="2026-07-28 13:47:01.449046329 +0000 UTC m=+45.839017533" Jul 28 13:47:01.464137 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.464086 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-rp8sv" podStartSLOduration=2.50236352 podStartE2EDuration="9.464070914s" totalImagesPullingTime="6.961707394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.462949207 +0000 UTC m=+45.852920417" watchObservedRunningTime="2026-07-28 13:47:01.464070914 +0000 UTC m=+45.854042100" Jul 28 13:47:01.482542 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.482506 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" podStartSLOduration=2.502945695 podStartE2EDuration="9.482494447s" totalImagesPullingTime="6.979548752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.481956825 +0000 UTC m=+45.871928034" watchObservedRunningTime="2026-07-28 13:47:01.482494447 +0000 UTC m=+45.872465654" Jul 28 13:47:01.504849 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.503056 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" podStartSLOduration=2.514726662 podStartE2EDuration="9.503039263s" totalImagesPullingTime="6.988312601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.500730413 +0000 UTC m=+45.890701621" watchObservedRunningTime="2026-07-28 13:47:01.503039263 +0000 UTC m=+45.893010469" Jul 28 13:47:01.520106 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.519894 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" podStartSLOduration=2.162638539 podStartE2EDuration="9.519879856s" totalImagesPullingTime="7.357241317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.519238806 +0000 UTC m=+45.909210014" watchObservedRunningTime="2026-07-28 13:47:01.519879856 +0000 UTC m=+45.909851064" Jul 28 13:47:01.575164 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.575105 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8pt4s" podStartSLOduration=2.573423202 podStartE2EDuration="11.575086562s" totalImagesPullingTime="9.00166336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.552725719 +0000 UTC m=+45.942696925" watchObservedRunningTime="2026-07-28 13:47:01.575086562 +0000 UTC m=+45.965057770" Jul 28 13:47:01.575601 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.575558 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-2mzg9" podStartSLOduration=3.136448501 podStartE2EDuration="9.575547671s" totalImagesPullingTime="6.43909917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:01.573097963 +0000 UTC m=+45.963069170" watchObservedRunningTime="2026-07-28 13:47:01.575547671 +0000 UTC m=+45.965518877" Jul 28 13:47:01.814582 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.814471 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gcp9m"] Jul 28 13:47:01.839046 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.839018 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcp9m"] Jul 28 13:47:01.839218 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.839138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.842063 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.842042 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t7z7s\"" Jul 28 13:47:01.842223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.842049 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 13:47:01.842286 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.842061 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 13:47:01.876604 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.876579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.876725 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.876661 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-data-volume\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.876725 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.876688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.876884 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.876738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xbfj\" (UniqueName: \"kubernetes.io/projected/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-api-access-9xbfj\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.876884 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.876783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-crio-socket\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.977731 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.977708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.977904 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.977823 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-data-volume\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.977904 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.977852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.977904 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:01.977890 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:47:01.977904 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.977900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xbfj\" (UniqueName: \"kubernetes.io/projected/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-api-access-9xbfj\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.978143 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.977964 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-crio-socket\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.978270 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:01.978241 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:47:01.978270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.978254 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-crio-socket\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.978270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.978256 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-data-volume\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:01.978270 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:01.978276 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:02.478254245 +0000 UTC m=+46.868225433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : secret "insights-runtime-extractor-tls" not found Jul 28 13:47:01.978474 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:01.978301 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:02.478289454 +0000 UTC m=+46.868260641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : configmap "kube-rbac-proxy" not found Jul 28 13:47:01.988821 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:01.988800 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xbfj\" (UniqueName: \"kubernetes.io/projected/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-api-access-9xbfj\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:02.114394 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.114364 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb"] Jul 28 13:47:02.147128 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.147095 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb"] Jul 28 13:47:02.147298 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.147229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" Jul 28 13:47:02.152395 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.152373 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 13:47:02.152946 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.152913 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 13:47:02.152946 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.152917 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wsxk7\"" Jul 28 13:47:02.180021 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.179997 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-678vh\" (UniqueName: \"kubernetes.io/projected/f53c078b-8b81-4a6f-b30c-ba48ad5e1721-kube-api-access-678vh\") pod \"migrator-6865c9967-88pjb\" (UID: \"f53c078b-8b81-4a6f-b30c-ba48ad5e1721\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" Jul 28 13:47:02.280854 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.280826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-678vh\" (UniqueName: \"kubernetes.io/projected/f53c078b-8b81-4a6f-b30c-ba48ad5e1721-kube-api-access-678vh\") pod \"migrator-6865c9967-88pjb\" (UID: \"f53c078b-8b81-4a6f-b30c-ba48ad5e1721\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" Jul 28 13:47:02.290138 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.290112 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-678vh\" (UniqueName: \"kubernetes.io/projected/f53c078b-8b81-4a6f-b30c-ba48ad5e1721-kube-api-access-678vh\") pod \"migrator-6865c9967-88pjb\" (UID: \"f53c078b-8b81-4a6f-b30c-ba48ad5e1721\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" Jul 28 13:47:02.424525 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.424462 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/1.log" Jul 28 13:47:02.424912 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.424871 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/0.log" Jul 28 13:47:02.424996 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.424911 2554 generic.go:356] "Generic (PLEG): container finished" podID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" exitCode=255 Jul 28 13:47:02.425049 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.425007 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" event={"ID":"e15d794e-19a1-4f0e-8f0a-df7b37cdd634","Type":"ContainerDied","Data":"c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0"} Jul 28 13:47:02.425084 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.425058 2554 scope.go:117] "RemoveContainer" containerID="6aeb9caee8af08983e99613689ef75517d6c001e14dde4a4c122dfef28fd3974" Jul 28 13:47:02.425274 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.425252 2554 scope.go:117] "RemoveContainer" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" Jul 28 13:47:02.425453 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:02.425431 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:02.457345 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.457328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" Jul 28 13:47:02.481939 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.481913 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:02.482084 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:02.482056 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:47:02.482147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.482087 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:02.482147 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:02.482113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:03.48209272 +0000 UTC m=+47.872063907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : secret "insights-runtime-extractor-tls" not found Jul 28 13:47:02.482147 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:02.482128 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:47:02.482303 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:02.482168 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:03.482157027 +0000 UTC m=+47.872128212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : configmap "kube-rbac-proxy" not found Jul 28 13:47:02.613493 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.613465 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb"] Jul 28 13:47:02.616464 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:02.616438 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53c078b_8b81_4a6f_b30c_ba48ad5e1721.slice/crio-3d972a7a310bf5c6122c692af40db4ab9e1593a59e1b04fa36d891dd5ead77bf WatchSource:0}: Error finding container 3d972a7a310bf5c6122c692af40db4ab9e1593a59e1b04fa36d891dd5ead77bf: Status 404 returned error can't find the container with id 3d972a7a310bf5c6122c692af40db4ab9e1593a59e1b04fa36d891dd5ead77bf Jul 28 13:47:02.907146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.907118 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:02.907298 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:02.907169 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:03.188515 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.188439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:47:03.188668 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:03.188558 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:47:03.188668 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:03.188614 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:11.188602519 +0000 UTC m=+55.578573703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:47:03.432533 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.432486 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" event={"ID":"f53c078b-8b81-4a6f-b30c-ba48ad5e1721","Type":"ContainerStarted","Data":"3d972a7a310bf5c6122c692af40db4ab9e1593a59e1b04fa36d891dd5ead77bf"} Jul 28 13:47:03.434143 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.434117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/1.log" Jul 28 13:47:03.434505 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.434480 2554 scope.go:117] "RemoveContainer" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" Jul 28 13:47:03.434660 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:03.434639 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:03.491555 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.491491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:03.491694 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.491560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:03.491694 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:03.491652 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:47:03.491794 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:03.491707 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:05.491690206 +0000 UTC m=+49.881661404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : secret "insights-runtime-extractor-tls" not found Jul 28 13:47:03.503851 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.503823 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:03.604117 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:03.604089 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sqj4g_6c4841ce-8f2c-43ac-a4fb-c3da29cd236f/dns-node-resolver/0.log" Jul 28 13:47:04.398927 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.398908 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jkmrc_5eae876f-cc9a-42a9-a66d-6fad0520fc77/node-ca/0.log" Jul 28 13:47:04.438815 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.438793 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" event={"ID":"f53c078b-8b81-4a6f-b30c-ba48ad5e1721","Type":"ContainerStarted","Data":"ab42fa8cfb9d17af8aa49c071199baa4d1fbc84af4013fda7c594bbecad8addf"} Jul 28 13:47:04.439147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.439130 2554 scope.go:117] "RemoveContainer" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" Jul 28 13:47:04.439305 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:04.439287 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:04.502392 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.502352 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-c744f"] Jul 28 13:47:04.531544 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.531522 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-c744f"] Jul 28 13:47:04.531634 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.531600 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.535693 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.535675 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 13:47:04.535950 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.535932 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 13:47:04.536662 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.536644 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rwrwp\"" Jul 28 13:47:04.536738 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.536693 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 13:47:04.536788 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.536742 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 13:47:04.600633 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.600574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89nqv\" (UniqueName: \"kubernetes.io/projected/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-kube-api-access-89nqv\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.600789 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.600768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-cabundle\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.600847 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.600799 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-key\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.701557 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.701528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-cabundle\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.701652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.701559 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-key\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.701652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.701599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89nqv\" (UniqueName: \"kubernetes.io/projected/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-kube-api-access-89nqv\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.702243 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.702228 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-cabundle\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.703691 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.703674 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-signing-key\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.710697 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.710680 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89nqv\" (UniqueName: \"kubernetes.io/projected/d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc-kube-api-access-89nqv\") pod \"service-ca-658d7b7c78-c744f\" (UID: \"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc\") " pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.839941 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.839914 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-c744f" Jul 28 13:47:04.975596 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:04.975450 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-c744f"] Jul 28 13:47:04.977890 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:04.977863 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15c283b_40c0_4ce1_ac2c_6f00adb1e3cc.slice/crio-307d9388ca1c77f1103fef9ae8e41fef78ad82945c7e2366da1487919e26e225 WatchSource:0}: Error finding container 307d9388ca1c77f1103fef9ae8e41fef78ad82945c7e2366da1487919e26e225: Status 404 returned error can't find the container with id 307d9388ca1c77f1103fef9ae8e41fef78ad82945c7e2366da1487919e26e225 Jul 28 13:47:05.000103 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.000082 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pt4s_45f38503-dc90-4dde-ad36-c07e7894a3a2/serve-healthcheck-canary/0.log" Jul 28 13:47:05.444084 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.444049 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-c744f" event={"ID":"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc","Type":"ContainerStarted","Data":"14ee088f2134f9556f4ab9ebdaba00923edb87885ed876cf52c498302927554a"} Jul 28 13:47:05.444507 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.444101 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-c744f" event={"ID":"d15c283b-40c0-4ce1-ac2c-6f00adb1e3cc","Type":"ContainerStarted","Data":"307d9388ca1c77f1103fef9ae8e41fef78ad82945c7e2366da1487919e26e225"} Jul 28 13:47:05.445875 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.445851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" event={"ID":"f53c078b-8b81-4a6f-b30c-ba48ad5e1721","Type":"ContainerStarted","Data":"f69b813c8c14d69a72f1c38e3f4f272d3c9bc0c64deaf6ddd758973a64ebc9d7"} Jul 28 13:47:05.462013 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.461946 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-c744f" podStartSLOduration=1.461932311 podStartE2EDuration="1.461932311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:05.461129983 +0000 UTC m=+49.851101190" watchObservedRunningTime="2026-07-28 13:47:05.461932311 +0000 UTC m=+49.851903518" Jul 28 13:47:05.479922 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.479885 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-88pjb" podStartSLOduration=1.769020533 podStartE2EDuration="3.47987659s" totalImagesPullingTime="1.710856057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:05.479771174 +0000 UTC m=+49.869742380" watchObservedRunningTime="2026-07-28 13:47:05.47987659 +0000 UTC m=+49.869847850" Jul 28 13:47:05.509145 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:05.509120 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:05.509291 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:05.509274 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:47:05.509364 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:05.509335 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:09.509318128 +0000 UTC m=+53.899289317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : secret "insights-runtime-extractor-tls" not found Jul 28 13:47:06.820671 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:06.820635 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:06.821178 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:06.820836 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:47:06.821178 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:06.820924 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls podName:76d03a97-ae81-4f43-8587-e8f185ab2a41 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:22.82090238 +0000 UTC m=+67.210873569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls") pod "dns-default-ld4m9" (UID: "76d03a97-ae81-4f43-8587-e8f185ab2a41") : secret "dns-default-metrics-tls" not found Jul 28 13:47:08.334387 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.334347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:47:08.336648 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.336628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/775472de-5e74-494c-9c33-e9d50daf0cda-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-8b4pk\" (UID: \"775472de-5e74-494c-9c33-e9d50daf0cda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:47:08.402774 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.402751 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" Jul 28 13:47:08.435437 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.435413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:08.435614 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.435565 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:47:08.435614 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.435580 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8644c54fb-vnsfd: secret "image-registry-tls" not found Jul 28 13:47:08.435730 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.435628 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls podName:df8877fd-a7f5-4437-8fd3-52cf4c347ab3 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:24.435612972 +0000 UTC m=+68.825584162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls") pod "image-registry-8644c54fb-vnsfd" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3") : secret "image-registry-tls" not found Jul 28 13:47:08.536788 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.536756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:47:08.536905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.536811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:08.536905 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.536894 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:08.537003 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.536910 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 13:47:08.537003 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.536967 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 13:47:08.537066 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.536992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls podName:ca60e8c9-dd6e-42ce-9d19-4d8477c357f7 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:24.536956463 +0000 UTC m=+68.926927665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7lms4" (UID: "ca60e8c9-dd6e-42ce-9d19-4d8477c357f7") : secret "cluster-monitoring-operator-tls" not found Jul 28 13:47:08.537066 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.537036 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:24.537022696 +0000 UTC m=+68.926993880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : configmap references non-existent config key: service-ca.crt Jul 28 13:47:08.537066 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:08.537051 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs podName:9bdc4799-efa6-4173-b9cd-31f86f5daa89 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:24.537045107 +0000 UTC m=+68.927016291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs") pod "router-default-866dc68ffc-g4w7d" (UID: "9bdc4799-efa6-4173-b9cd-31f86f5daa89") : secret "router-metrics-certs-default" not found Jul 28 13:47:08.542306 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:08.542283 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk"] Jul 28 13:47:09.462682 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:09.462650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" event={"ID":"775472de-5e74-494c-9c33-e9d50daf0cda","Type":"ContainerStarted","Data":"05fa20bd2fa8c51b198dc193e2c455cfa47f45d2fa3e5cb4aa5027313d724f34"} Jul 28 13:47:09.545310 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:09.545274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:09.545489 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:09.545455 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:47:09.545556 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:09.545520 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls podName:ee14a513-9e77-4d02-b6e1-ba4ea9cc1207 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:17.545500408 +0000 UTC m=+61.935471606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gcp9m" (UID: "ee14a513-9e77-4d02-b6e1-ba4ea9cc1207") : secret "insights-runtime-extractor-tls" not found Jul 28 13:47:11.260702 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:11.260662 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:47:11.261203 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:11.260802 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 13:47:11.261203 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:11.260862 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert podName:7bde103d-5ef7-4369-beec-6b0a5f769ce0 nodeName:}" failed. No retries permitted until 2026-07-28 13:47:27.260846347 +0000 UTC m=+71.650817531 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-lptr4" (UID: "7bde103d-5ef7-4369-beec-6b0a5f769ce0") : secret "networking-console-plugin-cert" not found Jul 28 13:47:11.470838 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:11.470801 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" event={"ID":"775472de-5e74-494c-9c33-e9d50daf0cda","Type":"ContainerStarted","Data":"46d19d3f3f2e289855a08f38a913429e7a3d6f99ea567143eced8a5196aac69c"} Jul 28 13:47:11.471068 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:11.470894 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" event={"ID":"775472de-5e74-494c-9c33-e9d50daf0cda","Type":"ContainerStarted","Data":"97b87b575d38413fce57126ae5468eff42c63240c39e16ba466ef92f62ab2a24"} Jul 28 13:47:11.489190 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:11.489140 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-8b4pk" podStartSLOduration=17.481051936 podStartE2EDuration="19.489127845s" totalImagesPullingTime="2.008075909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:11.488836992 +0000 UTC m=+55.878808198" watchObservedRunningTime="2026-07-28 13:47:11.489127845 +0000 UTC m=+55.879099051" Jul 28 13:47:15.325064 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:15.325028 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8l6c5" Jul 28 13:47:17.618986 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:17.618917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:17.621270 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:17.621245 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee14a513-9e77-4d02-b6e1-ba4ea9cc1207-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gcp9m\" (UID: \"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207\") " pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:17.751395 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:17.751369 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t7z7s\"" Jul 28 13:47:17.759311 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:17.759294 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gcp9m" Jul 28 13:47:17.948186 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:17.948113 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gcp9m"] Jul 28 13:47:17.951519 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:17.951494 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee14a513_9e77_4d02_b6e1_ba4ea9cc1207.slice/crio-08090a8754a11ee3f04a6b5ed41e67ba6b658b3458288cb46cad7dae7bd51151 WatchSource:0}: Error finding container 08090a8754a11ee3f04a6b5ed41e67ba6b658b3458288cb46cad7dae7bd51151: Status 404 returned error can't find the container with id 08090a8754a11ee3f04a6b5ed41e67ba6b658b3458288cb46cad7dae7bd51151 Jul 28 13:47:18.135252 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.135224 2554 scope.go:117] "RemoveContainer" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" Jul 28 13:47:18.493635 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.493570 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:47:18.494004 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.493968 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/1.log" Jul 28 13:47:18.494054 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.494016 2554 generic.go:356] "Generic (PLEG): container finished" podID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" containerID="7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0" exitCode=255 Jul 28 13:47:18.494106 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.494087 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" event={"ID":"e15d794e-19a1-4f0e-8f0a-df7b37cdd634","Type":"ContainerDied","Data":"7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0"} Jul 28 13:47:18.494158 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.494144 2554 scope.go:117] "RemoveContainer" containerID="c8f6c4fd593ea2cfdff1deff12a33fc6aa03a0a835731755f7461074749787a0" Jul 28 13:47:18.494461 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.494438 2554 scope.go:117] "RemoveContainer" containerID="7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0" Jul 28 13:47:18.494664 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:18.494641 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:18.495253 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:18.495233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcp9m" event={"ID":"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207","Type":"ContainerStarted","Data":"08090a8754a11ee3f04a6b5ed41e67ba6b658b3458288cb46cad7dae7bd51151"} Jul 28 13:47:19.500116 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:19.500094 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:47:21.757800 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.757760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:47:21.758376 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.757865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:47:21.760821 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.760790 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzqm\" (UniqueName: \"kubernetes.io/projected/ad9408d2-46a8-4b0b-812b-14a220b8c26d-kube-api-access-tfzqm\") pod \"network-check-target-xbjrs\" (UID: \"ad9408d2-46a8-4b0b-812b-14a220b8c26d\") " pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:47:21.760954 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.760909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:47:21.770396 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.770376 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8fb47319-a07f-41ae-b273-5e100eed0f4f-metrics-certs\") pod \"network-metrics-daemon-n5546\" (UID: \"8fb47319-a07f-41ae-b273-5e100eed0f4f\") " pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:47:21.859068 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.859029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:47:21.862074 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.861923 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:47:21.872175 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:21.872148 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21382e6a-33e2-412a-9f0e-996c44b89351-original-pull-secret\") pod \"global-pull-secret-syncer-2w4qv\" (UID: \"21382e6a-33e2-412a-9f0e-996c44b89351\") " pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:47:22.043921 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.043852 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2w4qv" Jul 28 13:47:22.051784 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.051754 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26q9h\"" Jul 28 13:47:22.056108 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.056085 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw72x\"" Jul 28 13:47:22.059411 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.059393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:47:22.064159 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.064139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n5546" Jul 28 13:47:22.866378 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.866344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:22.869058 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.869035 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/76d03a97-ae81-4f43-8587-e8f185ab2a41-metrics-tls\") pod \"dns-default-ld4m9\" (UID: \"76d03a97-ae81-4f43-8587-e8f185ab2a41\") " pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:22.907090 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.907064 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:22.907221 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.907120 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:22.907455 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:22.907440 2554 scope.go:117] "RemoveContainer" containerID="7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0" Jul 28 13:47:22.907653 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:22.907630 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:23.088857 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.088827 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l8nws\"" Jul 28 13:47:23.097109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.097083 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:23.412821 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:23.412719 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d03a97_ae81_4f43_8587_e8f185ab2a41.slice/crio-bff573b5dcff36908118c9588bdcb378d3cbf4e33c49e4b1bfb6192d1f972043 WatchSource:0}: Error finding container bff573b5dcff36908118c9588bdcb378d3cbf4e33c49e4b1bfb6192d1f972043: Status 404 returned error can't find the container with id bff573b5dcff36908118c9588bdcb378d3cbf4e33c49e4b1bfb6192d1f972043 Jul 28 13:47:23.415265 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.415235 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ld4m9"] Jul 28 13:47:23.432398 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.428985 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n5546"] Jul 28 13:47:23.514329 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.514252 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcp9m" event={"ID":"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207","Type":"ContainerStarted","Data":"3535472e62167b6244b3e183015296cfac6dd54f67e96823a92caeecb39e9207"} Jul 28 13:47:23.515344 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.515320 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld4m9" event={"ID":"76d03a97-ae81-4f43-8587-e8f185ab2a41","Type":"ContainerStarted","Data":"bff573b5dcff36908118c9588bdcb378d3cbf4e33c49e4b1bfb6192d1f972043"} Jul 28 13:47:23.516426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.516405 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n5546" event={"ID":"8fb47319-a07f-41ae-b273-5e100eed0f4f","Type":"ContainerStarted","Data":"a67473fcab732a0a1c210d4f3342de6d135012f354338f78b3bd7521f2e8c467"} Jul 28 13:47:23.652927 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.652904 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2w4qv"] Jul 28 13:47:23.655801 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:23.655773 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xbjrs"] Jul 28 13:47:23.655801 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:23.655785 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21382e6a_33e2_412a_9f0e_996c44b89351.slice/crio-cee7937531e8c9dd510e6bc40ba07e38efd9afe16f3f1a915c4e9926d83e412f WatchSource:0}: Error finding container cee7937531e8c9dd510e6bc40ba07e38efd9afe16f3f1a915c4e9926d83e412f: Status 404 returned error can't find the container with id cee7937531e8c9dd510e6bc40ba07e38efd9afe16f3f1a915c4e9926d83e412f Jul 28 13:47:23.659285 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:23.659241 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9408d2_46a8_4b0b_812b_14a220b8c26d.slice/crio-2f194960ef32ad9468fef7f88b9713d87ac7292fa099efd88d96ed142d57f977 WatchSource:0}: Error finding container 2f194960ef32ad9468fef7f88b9713d87ac7292fa099efd88d96ed142d57f977: Status 404 returned error can't find the container with id 2f194960ef32ad9468fef7f88b9713d87ac7292fa099efd88d96ed142d57f977 Jul 28 13:47:24.481518 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.481473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:24.485496 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.485449 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"image-registry-8644c54fb-vnsfd\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:24.523376 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.523295 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2w4qv" event={"ID":"21382e6a-33e2-412a-9f0e-996c44b89351","Type":"ContainerStarted","Data":"cee7937531e8c9dd510e6bc40ba07e38efd9afe16f3f1a915c4e9926d83e412f"} Jul 28 13:47:24.526746 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.526683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xbjrs" event={"ID":"ad9408d2-46a8-4b0b-812b-14a220b8c26d","Type":"ContainerStarted","Data":"06e75a7f2efab2400c9e50db4ca964669ec8f6c873a46ef78b0e4b7c3b355aa6"} Jul 28 13:47:24.527653 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.527294 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:47:24.527653 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.527328 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xbjrs" event={"ID":"ad9408d2-46a8-4b0b-812b-14a220b8c26d","Type":"ContainerStarted","Data":"2f194960ef32ad9468fef7f88b9713d87ac7292fa099efd88d96ed142d57f977"} Jul 28 13:47:24.582837 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.582174 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:24.582837 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.582237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:47:24.582837 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.582275 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:24.583489 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.583411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bdc4799-efa6-4173-b9cd-31f86f5daa89-service-ca-bundle\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:24.585307 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.585266 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9bdc4799-efa6-4173-b9cd-31f86f5daa89-metrics-certs\") pod \"router-default-866dc68ffc-g4w7d\" (UID: \"9bdc4799-efa6-4173-b9cd-31f86f5daa89\") " pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:24.586121 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.586097 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca60e8c9-dd6e-42ce-9d19-4d8477c357f7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7lms4\" (UID: \"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:47:24.625938 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.625909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8pkhn\"" Jul 28 13:47:24.634434 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.634408 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:24.721426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.720925 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tzxlw\"" Jul 28 13:47:24.725919 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.725507 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lv685\"" Jul 28 13:47:24.725919 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.725704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" Jul 28 13:47:24.734132 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:24.734016 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:25.671495 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.671448 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xbjrs" podStartSLOduration=68.671432024 podStartE2EDuration="1m8.671432024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:24.545520344 +0000 UTC m=+68.935491551" watchObservedRunningTime="2026-07-28 13:47:25.671432024 +0000 UTC m=+70.061403238" Jul 28 13:47:25.672558 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.672536 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:47:25.696037 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.696008 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6474cf9d66-hp9k9"] Jul 28 13:47:25.712777 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.712748 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.717109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.715822 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6474cf9d66-hp9k9"] Jul 28 13:47:25.792839 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.792809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-ca-trust-extracted\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.792867 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-tls\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.792950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-trusted-ca\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.792999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wbjq\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-kube-api-access-7wbjq\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.793039 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-certificates\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793221 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.793087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-installation-pull-secrets\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793221 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.793107 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-image-registry-private-configuration\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.793221 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.793131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-bound-sa-token\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894386 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-ca-trust-extracted\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894398 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-tls\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894558 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-trusted-ca\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wbjq\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-kube-api-access-7wbjq\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894639 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-certificates\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894793 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-installation-pull-secrets\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894793 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-image-registry-private-configuration\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894793 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894733 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-bound-sa-token\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.894793 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.894763 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-ca-trust-extracted\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.895996 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.895908 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-trusted-ca\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.896597 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.896568 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-certificates\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.898295 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.898269 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-installation-pull-secrets\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.899012 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.898986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-registry-tls\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.899586 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.899544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-image-registry-private-configuration\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.904589 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.904549 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wbjq\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-kube-api-access-7wbjq\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:25.906077 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:25.906037 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ccc8a9b-cfa3-4565-bbec-e0ef513699c0-bound-sa-token\") pod \"image-registry-6474cf9d66-hp9k9\" (UID: \"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0\") " pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:26.026297 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:26.026188 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:27.306449 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:27.306404 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:47:27.308853 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:27.308827 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bde103d-5ef7-4369-beec-6b0a5f769ce0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-lptr4\" (UID: \"7bde103d-5ef7-4369-beec-6b0a5f769ce0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:47:27.547586 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:27.547555 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-5f8gh\"" Jul 28 13:47:27.554909 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:27.554886 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" Jul 28 13:47:29.149588 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:29.149461 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4"] Jul 28 13:47:29.941679 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:29.941592 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca60e8c9_dd6e_42ce_9d19_4d8477c357f7.slice/crio-2fc9976cdaf54df83c56cd3d8fa6aba220e7a954f6615f33116909684991f71c WatchSource:0}: Error finding container 2fc9976cdaf54df83c56cd3d8fa6aba220e7a954f6615f33116909684991f71c: Status 404 returned error can't find the container with id 2fc9976cdaf54df83c56cd3d8fa6aba220e7a954f6615f33116909684991f71c Jul 28 13:47:30.073227 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.073193 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:47:30.127295 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:30.127260 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8877fd_a7f5_4437_8fd3_52cf4c347ab3.slice/crio-0671930c824f74c17cf2e40833796f31a97aa37b042ee1e6b7623da30f056903 WatchSource:0}: Error finding container 0671930c824f74c17cf2e40833796f31a97aa37b042ee1e6b7623da30f056903: Status 404 returned error can't find the container with id 0671930c824f74c17cf2e40833796f31a97aa37b042ee1e6b7623da30f056903 Jul 28 13:47:30.305439 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.305406 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6474cf9d66-hp9k9"] Jul 28 13:47:30.310879 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:30.310855 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccc8a9b_cfa3_4565_bbec_e0ef513699c0.slice/crio-fd64a3731cb5a075c294dec0db1ae6d9b6e0f4bd2ed85ba762f69ae703eeb657 WatchSource:0}: Error finding container fd64a3731cb5a075c294dec0db1ae6d9b6e0f4bd2ed85ba762f69ae703eeb657: Status 404 returned error can't find the container with id fd64a3731cb5a075c294dec0db1ae6d9b6e0f4bd2ed85ba762f69ae703eeb657 Jul 28 13:47:30.324847 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.324811 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-lptr4"] Jul 28 13:47:30.327484 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:30.327449 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bde103d_5ef7_4369_beec_6b0a5f769ce0.slice/crio-8800c0fa1dcb5cae5de54d885e193711824f56afcc0eb8a83c69f7cf1a015926 WatchSource:0}: Error finding container 8800c0fa1dcb5cae5de54d885e193711824f56afcc0eb8a83c69f7cf1a015926: Status 404 returned error can't find the container with id 8800c0fa1dcb5cae5de54d885e193711824f56afcc0eb8a83c69f7cf1a015926 Jul 28 13:47:30.532302 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.532229 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-866dc68ffc-g4w7d"] Jul 28 13:47:30.559279 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.559181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" event={"ID":"9bdc4799-efa6-4173-b9cd-31f86f5daa89","Type":"ContainerStarted","Data":"6ed079a1f6377ae3412d314785c828d9295be423af12a37f07b4cecd32dab778"} Jul 28 13:47:30.565106 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.565025 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n5546" event={"ID":"8fb47319-a07f-41ae-b273-5e100eed0f4f","Type":"ContainerStarted","Data":"0ac3b98287af26a7f42ecfd45a2f842330e37d153e619952f78d5c413c0bd474"} Jul 28 13:47:30.567467 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.567221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" event={"ID":"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7","Type":"ContainerStarted","Data":"2fc9976cdaf54df83c56cd3d8fa6aba220e7a954f6615f33116909684991f71c"} Jul 28 13:47:30.569231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.569166 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" event={"ID":"7bde103d-5ef7-4369-beec-6b0a5f769ce0","Type":"ContainerStarted","Data":"8800c0fa1dcb5cae5de54d885e193711824f56afcc0eb8a83c69f7cf1a015926"} Jul 28 13:47:30.571910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.571883 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld4m9" event={"ID":"76d03a97-ae81-4f43-8587-e8f185ab2a41","Type":"ContainerStarted","Data":"00ece930bb11f30a97021ea24a68346dbbcb60fd718706f358064b50fce329fc"} Jul 28 13:47:30.574243 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.574220 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" event={"ID":"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0","Type":"ContainerStarted","Data":"fd64a3731cb5a075c294dec0db1ae6d9b6e0f4bd2ed85ba762f69ae703eeb657"} Jul 28 13:47:30.576548 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.576406 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2w4qv" event={"ID":"21382e6a-33e2-412a-9f0e-996c44b89351","Type":"ContainerStarted","Data":"1ca887fba502bf02761ee0ae10b166f4fed771826144fac99e1b2c0bed76181e"} Jul 28 13:47:30.581467 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.581440 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" event={"ID":"df8877fd-a7f5-4437-8fd3-52cf4c347ab3","Type":"ContainerStarted","Data":"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299"} Jul 28 13:47:30.581551 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.581488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" event={"ID":"df8877fd-a7f5-4437-8fd3-52cf4c347ab3","Type":"ContainerStarted","Data":"0671930c824f74c17cf2e40833796f31a97aa37b042ee1e6b7623da30f056903"} Jul 28 13:47:30.581749 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.581729 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:30.600085 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.599875 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2w4qv" podStartSLOduration=67.126879073 podStartE2EDuration="1m13.599854648s" totalImagesPullingTime="6.472975575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:30.598267453 +0000 UTC m=+74.988238661" watchObservedRunningTime="2026-07-28 13:47:30.599854648 +0000 UTC m=+74.989825855" Jul 28 13:47:30.619710 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:30.619659 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" podStartSLOduration=38.619641192 podStartE2EDuration="38.619641192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:30.618375357 +0000 UTC m=+75.008346590" watchObservedRunningTime="2026-07-28 13:47:30.619641192 +0000 UTC m=+75.009612399" Jul 28 13:47:31.588926 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.588817 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ld4m9" event={"ID":"76d03a97-ae81-4f43-8587-e8f185ab2a41","Type":"ContainerStarted","Data":"63ac77fa5a5540e3864058b4ad4ce11adefa66987ad3ac7451385e619eb8452c"} Jul 28 13:47:31.589384 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.589047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:31.591420 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.591389 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcp9m" event={"ID":"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207","Type":"ContainerStarted","Data":"f3b57ea265f5bff18fa092afba6ce620c24b5db194193171180836d8538af07d"} Jul 28 13:47:31.593034 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.593005 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" event={"ID":"6ccc8a9b-cfa3-4565-bbec-e0ef513699c0","Type":"ContainerStarted","Data":"200a1e20513c063ff07a27e910284ca0c84134a4f1dfb97accf99e2cd435ada6"} Jul 28 13:47:31.593172 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.593145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:31.594990 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.594945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" event={"ID":"9bdc4799-efa6-4173-b9cd-31f86f5daa89","Type":"ContainerStarted","Data":"f53a9b63681489616c089522e11c5c4d05d1c28749f9e212311f86d000e4b22b"} Jul 28 13:47:31.598288 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.598149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n5546" event={"ID":"8fb47319-a07f-41ae-b273-5e100eed0f4f","Type":"ContainerStarted","Data":"790902cbc17c379ffbb091059682584a2ccc666dc40e671ab56317cd48f69f89"} Jul 28 13:47:31.610165 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.610073 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ld4m9" podStartSLOduration=34.895262694 podStartE2EDuration="41.610056973s" totalImagesPullingTime="6.714794279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:31.609087192 +0000 UTC m=+75.999058399" watchObservedRunningTime="2026-07-28 13:47:31.610056973 +0000 UTC m=+76.000028181" Jul 28 13:47:31.631595 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.631075 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" podStartSLOduration=6.63105547 podStartE2EDuration="6.63105547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:31.630143905 +0000 UTC m=+76.020115113" watchObservedRunningTime="2026-07-28 13:47:31.63105547 +0000 UTC m=+76.021026658" Jul 28 13:47:31.654130 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.652613 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" podStartSLOduration=39.652598215 podStartE2EDuration="39.652598215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:31.652195128 +0000 UTC m=+76.042166335" watchObservedRunningTime="2026-07-28 13:47:31.652598215 +0000 UTC m=+76.042569423" Jul 28 13:47:31.673799 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.673724 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n5546" podStartSLOduration=69.082389833 podStartE2EDuration="1m14.673699718s" totalImagesPullingTime="5.591309885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:31.672556456 +0000 UTC m=+76.062527674" watchObservedRunningTime="2026-07-28 13:47:31.673699718 +0000 UTC m=+76.063670927" Jul 28 13:47:31.734679 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.734649 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:31.737686 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:31.737485 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:32.601855 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:32.601773 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:32.602989 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:32.602953 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-866dc68ffc-g4w7d" Jul 28 13:47:34.612402 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.612302 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gcp9m" event={"ID":"ee14a513-9e77-4d02-b6e1-ba4ea9cc1207","Type":"ContainerStarted","Data":"2060bad737f1a2377d8dc6884ed992097e43acfe73c1de9f6862b4d8c531828a"} Jul 28 13:47:34.614191 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.614152 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" event={"ID":"ca60e8c9-dd6e-42ce-9d19-4d8477c357f7","Type":"ContainerStarted","Data":"2752e9315d2190a3f1375f57ffa5f73dc620cc92b9ef9e5ec6ccdae1f4aff7bf"} Jul 28 13:47:34.615709 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.615671 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" event={"ID":"7bde103d-5ef7-4369-beec-6b0a5f769ce0","Type":"ContainerStarted","Data":"1711eb5f677b5bada8f97772daed75c6dad11705bce451b2509c7e4fe49161aa"} Jul 28 13:47:34.635539 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.635498 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gcp9m" podStartSLOduration=17.474390579 podStartE2EDuration="33.63548452s" totalImagesPullingTime="16.161093941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:47:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:34.634829495 +0000 UTC m=+79.024800702" watchObservedRunningTime="2026-07-28 13:47:34.63548452 +0000 UTC m=+79.025455725" Jul 28 13:47:34.655379 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.655333 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7lms4" podStartSLOduration=38.267234807 podStartE2EDuration="42.655319767s" totalImagesPullingTime="4.38808496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:34.653999849 +0000 UTC m=+79.043971058" watchObservedRunningTime="2026-07-28 13:47:34.655319767 +0000 UTC m=+79.045290972" Jul 28 13:47:34.672552 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:34.672504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-lptr4" podStartSLOduration=35.639255612 podStartE2EDuration="39.672492668s" totalImagesPullingTime="4.033237056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:34.671988335 +0000 UTC m=+79.061959543" watchObservedRunningTime="2026-07-28 13:47:34.672492668 +0000 UTC m=+79.062463874" Jul 28 13:47:37.134634 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:37.134600 2554 scope.go:117] "RemoveContainer" containerID="7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0" Jul 28 13:47:37.135075 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:37.134764 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-kj86r_openshift-console-operator(e15d794e-19a1-4f0e-8f0a-df7b37cdd634)\"" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podUID="e15d794e-19a1-4f0e-8f0a-df7b37cdd634" Jul 28 13:47:41.603331 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:41.603218 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ld4m9" Jul 28 13:47:48.391533 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.391501 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mssnf"] Jul 28 13:47:48.395018 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.394992 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.398073 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.398044 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 13:47:48.399146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.399062 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 13:47:48.399146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.399113 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 13:47:48.399323 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.399113 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-88xsk\"" Jul 28 13:47:48.399323 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.399116 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 13:47:48.474588 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2wz\" (UniqueName: \"kubernetes.io/projected/a1aa01f5-0977-4d60-b486-90b19734a78a-kube-api-access-dl2wz\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474588 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474591 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-wtmp\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474778 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-sys\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474778 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474624 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-textfile\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474778 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-root\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474778 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-metrics-client-ca\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474938 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474779 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474938 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474819 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.474938 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.474870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-tls\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-tls\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575433 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2wz\" (UniqueName: \"kubernetes.io/projected/a1aa01f5-0977-4d60-b486-90b19734a78a-kube-api-access-dl2wz\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-wtmp\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575489 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-sys\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-textfile\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575549 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-root\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-metrics-client-ca\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576146 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.575671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.576795 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.576779 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-sys\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.577042 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.577024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-wtmp\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.577152 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.577123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aa01f5-0977-4d60-b486-90b19734a78a-root\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.577395 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.577372 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-textfile\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.577956 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.577911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.578618 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.578593 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa01f5-0977-4d60-b486-90b19734a78a-metrics-client-ca\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.581205 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.581165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-tls\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.581307 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.581232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aa01f5-0977-4d60-b486-90b19734a78a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.586252 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.586226 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2wz\" (UniqueName: \"kubernetes.io/projected/a1aa01f5-0977-4d60-b486-90b19734a78a-kube-api-access-dl2wz\") pod \"node-exporter-mssnf\" (UID: \"a1aa01f5-0977-4d60-b486-90b19734a78a\") " pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.704243 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:48.704161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mssnf" Jul 28 13:47:48.716841 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:48.716813 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1aa01f5_0977_4d60_b486_90b19734a78a.slice/crio-d85747e9b684f404b0672f6d1a1080acabad004745cc40f48493923b2b8ca9f8 WatchSource:0}: Error finding container d85747e9b684f404b0672f6d1a1080acabad004745cc40f48493923b2b8ca9f8: Status 404 returned error can't find the container with id d85747e9b684f404b0672f6d1a1080acabad004745cc40f48493923b2b8ca9f8 Jul 28 13:47:49.672617 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:49.672581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mssnf" event={"ID":"a1aa01f5-0977-4d60-b486-90b19734a78a","Type":"ContainerStarted","Data":"d85747e9b684f404b0672f6d1a1080acabad004745cc40f48493923b2b8ca9f8"} Jul 28 13:47:50.135138 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.135105 2554 scope.go:117] "RemoveContainer" containerID="7be2139e58de0043618b093118c7d0f20c00ab9669c1a78a6a1fea33989665e0" Jul 28 13:47:50.587752 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.587728 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:50.678259 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.678230 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:47:50.678656 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.678327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" event={"ID":"e15d794e-19a1-4f0e-8f0a-df7b37cdd634","Type":"ContainerStarted","Data":"4fa867c082f117cdfe4dc83d0d669f9e961abc19b2283f3d188b359cabca7ad8"} Jul 28 13:47:50.678656 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.678612 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:50.680049 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.680023 2554 generic.go:356] "Generic (PLEG): container finished" podID="a1aa01f5-0977-4d60-b486-90b19734a78a" containerID="19275f384e0c133d0f22eccf7f506dd859ad860b8fd67151862f584e8b7dde1f" exitCode=0 Jul 28 13:47:50.680154 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.680101 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mssnf" event={"ID":"a1aa01f5-0977-4d60-b486-90b19734a78a","Type":"ContainerDied","Data":"19275f384e0c133d0f22eccf7f506dd859ad860b8fd67151862f584e8b7dde1f"} Jul 28 13:47:50.698201 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.698138 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" podStartSLOduration=51.736573637 podStartE2EDuration="58.698119721s" totalImagesPullingTime="6.961546084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:50.696888503 +0000 UTC m=+95.086859710" watchObservedRunningTime="2026-07-28 13:47:50.698119721 +0000 UTC m=+95.088090929" Jul 28 13:47:50.989640 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:50.989565 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-kj86r" Jul 28 13:47:51.689343 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:51.689304 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mssnf" event={"ID":"a1aa01f5-0977-4d60-b486-90b19734a78a","Type":"ContainerStarted","Data":"a6e4a559987764d6c6699f63eea5e0e0df362021295a4b9b7038e7b1caaf0c89"} Jul 28 13:47:51.689798 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:51.689377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mssnf" event={"ID":"a1aa01f5-0977-4d60-b486-90b19734a78a","Type":"ContainerStarted","Data":"97e5205cd99498a02ee9247d7f8eb3436d153148f848ad502cbb4ce72bba84b3"} Jul 28 13:47:51.712231 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:51.712186 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mssnf" podStartSLOduration=2.6211027810000003 podStartE2EDuration="3.712171956s" totalImagesPullingTime="1.027964753s" totalInitContainerRuntime="63.104422ms" isStatefulPod=true podCreationTimestamp="2026-07-28 13:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:51.710115878 +0000 UTC m=+96.100087097" watchObservedRunningTime="2026-07-28 13:47:51.712171956 +0000 UTC m=+96.102143161" Jul 28 13:47:52.606194 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:52.606168 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6474cf9d66-hp9k9" Jul 28 13:47:55.533031 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.533002 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xbjrs" Jul 28 13:47:55.610020 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.609962 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" podUID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" containerName="registry" containerID="cri-o://76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299" gracePeriod=30 Jul 28 13:47:55.877265 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.877238 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:55.893918 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.893886 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:47:55.894351 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.894335 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" containerName="registry" Jul 28 13:47:55.894351 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.894352 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" containerName="registry" Jul 28 13:47:55.894464 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.894411 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" containerName="registry" Jul 28 13:47:55.917225 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.917204 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:47:55.917335 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.917283 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.920032 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920015 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 13:47:55.920193 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920169 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 13:47:55.920310 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920047 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 13:47:55.920310 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jffvt\"" Jul 28 13:47:55.920310 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 13:47:55.920444 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920348 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 13:47:55.920444 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920365 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 13:47:55.920529 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.920488 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 13:47:55.938849 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.938831 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.938955 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.938899 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.938955 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.938919 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2xb4\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.938955 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.938944 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.939147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.938967 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.939147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939011 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.939147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939121 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.939289 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939166 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token\") pod \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\" (UID: \"df8877fd-a7f5-4437-8fd3-52cf4c347ab3\") " Jul 28 13:47:55.939289 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.939393 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.939393 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939325 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:55.939393 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939367 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.939531 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939406 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:55.939531 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939416 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.939630 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.939630 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.939563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8lc\" (UniqueName: \"kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:55.941558 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.941528 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:47:55.941660 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.941631 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:47:55.941730 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.941688 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4" (OuterVolumeSpecName: "kube-api-access-j2xb4") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "kube-api-access-j2xb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:47:55.941827 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.941802 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:47:55.941912 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.941891 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:47:55.948590 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:55.948570 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "df8877fd-a7f5-4437-8fd3-52cf4c347ab3" (UID: "df8877fd-a7f5-4437-8fd3-52cf4c347ab3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:47:56.040568 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040568 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040551 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040568 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8lc\" (UniqueName: \"kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040588 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040613 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040640 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040674 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-trusted-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040689 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-certificates\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040702 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2xb4\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-kube-api-access-j2xb4\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040716 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-installation-pull-secrets\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040730 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-image-registry-private-configuration\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040743 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-registry-tls\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040755 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-ca-trust-extracted\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.040775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.040767 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df8877fd-a7f5-4437-8fd3-52cf4c347ab3-bound-sa-token\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.041416 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.041280 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.041416 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.041313 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.041416 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.041336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.042802 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.042783 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.042879 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.042864 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.049203 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.049179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8lc\" (UniqueName: \"kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc\") pod \"console-8d7c987cd-z545x\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.226600 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.226553 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:47:56.418266 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.418239 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:47:56.420510 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:47:56.420483 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83bcad8_1469_4b3e_ad69_e324d3faf9f5.slice/crio-b93c7b675169051c0f19b9c918e8a404f768ba497d7ac1fbbd7ef24f78689415 WatchSource:0}: Error finding container b93c7b675169051c0f19b9c918e8a404f768ba497d7ac1fbbd7ef24f78689415: Status 404 returned error can't find the container with id b93c7b675169051c0f19b9c918e8a404f768ba497d7ac1fbbd7ef24f78689415 Jul 28 13:47:56.710491 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.710454 2554 generic.go:356] "Generic (PLEG): container finished" podID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" containerID="76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299" exitCode=0 Jul 28 13:47:56.710902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.710502 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" Jul 28 13:47:56.710902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.710541 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" event={"ID":"df8877fd-a7f5-4437-8fd3-52cf4c347ab3","Type":"ContainerDied","Data":"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299"} Jul 28 13:47:56.710902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.710592 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8644c54fb-vnsfd" event={"ID":"df8877fd-a7f5-4437-8fd3-52cf4c347ab3","Type":"ContainerDied","Data":"0671930c824f74c17cf2e40833796f31a97aa37b042ee1e6b7623da30f056903"} Jul 28 13:47:56.710902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.710617 2554 scope.go:117] "RemoveContainer" containerID="76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299" Jul 28 13:47:56.711997 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.711957 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d7c987cd-z545x" event={"ID":"c83bcad8-1469-4b3e-ad69-e324d3faf9f5","Type":"ContainerStarted","Data":"b93c7b675169051c0f19b9c918e8a404f768ba497d7ac1fbbd7ef24f78689415"} Jul 28 13:47:56.718634 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.718619 2554 scope.go:117] "RemoveContainer" containerID="76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299" Jul 28 13:47:56.718908 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:47:56.718887 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299\": container with ID starting with 76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299 not found: ID does not exist" containerID="76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299" Jul 28 13:47:56.718956 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.718915 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299"} err="failed to get container status \"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299\": rpc error: code = NotFound desc = could not find container \"76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299\": container with ID starting with 76fa7f83fccca52af06296fb9644c7f3396c1ce0e3889ebf06d81acd78b22299 not found: ID does not exist" Jul 28 13:47:56.729197 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.729176 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:47:56.733005 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:56.732984 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8644c54fb-vnsfd"] Jul 28 13:47:58.141058 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:47:58.141013 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df8877fd-a7f5-4437-8fd3-52cf4c347ab3" path="/var/lib/kubelet/pods/df8877fd-a7f5-4437-8fd3-52cf4c347ab3/volumes" Jul 28 13:48:00.284640 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.284571 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:48:00.300222 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.300197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.300768 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.300746 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:48:00.308885 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.308863 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 13:48:00.378459 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378436 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378587 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378587 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378527 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378682 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378682 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378682 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpr9v\" (UniqueName: \"kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.378794 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.378699 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479475 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479491 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479521 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479550 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpr9v\" (UniqueName: \"kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.479871 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.479655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.480327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.480306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.480327 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.480322 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.480497 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.480335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.480655 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.480623 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.482044 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.482024 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.482147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.482131 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.496931 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.496911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpr9v\" (UniqueName: \"kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v\") pod \"console-7c8676dc9d-22cf7\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.611489 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.611459 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:00.733457 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.733417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d7c987cd-z545x" event={"ID":"c83bcad8-1469-4b3e-ad69-e324d3faf9f5","Type":"ContainerStarted","Data":"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032"} Jul 28 13:48:00.756025 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.755958 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d7c987cd-z545x" podStartSLOduration=2.175941883 podStartE2EDuration="5.75594239s" totalImagesPullingTime="3.580000507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:00.755491135 +0000 UTC m=+105.145462340" watchObservedRunningTime="2026-07-28 13:48:00.75594239 +0000 UTC m=+105.145913595" Jul 28 13:48:00.769660 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:00.769639 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:48:00.771820 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:48:00.771797 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1eda7c4_3229_464c_a7ec_40cc4db02559.slice/crio-04b40651a85411f8c9ea993b28e1968e0e25cedd5468e9f3ef43806671f9a1d6 WatchSource:0}: Error finding container 04b40651a85411f8c9ea993b28e1968e0e25cedd5468e9f3ef43806671f9a1d6: Status 404 returned error can't find the container with id 04b40651a85411f8c9ea993b28e1968e0e25cedd5468e9f3ef43806671f9a1d6 Jul 28 13:48:01.739065 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:01.739018 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8676dc9d-22cf7" event={"ID":"a1eda7c4-3229-464c-a7ec-40cc4db02559","Type":"ContainerStarted","Data":"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f"} Jul 28 13:48:01.739568 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:01.739098 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8676dc9d-22cf7" event={"ID":"a1eda7c4-3229-464c-a7ec-40cc4db02559","Type":"ContainerStarted","Data":"04b40651a85411f8c9ea993b28e1968e0e25cedd5468e9f3ef43806671f9a1d6"} Jul 28 13:48:01.758174 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:01.758127 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c8676dc9d-22cf7" podStartSLOduration=1.7581115710000002 podStartE2EDuration="1.758111571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:01.756884654 +0000 UTC m=+106.146855859" watchObservedRunningTime="2026-07-28 13:48:01.758111571 +0000 UTC m=+106.148082778" Jul 28 13:48:06.226993 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.226948 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:06.227452 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.227022 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:06.231652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.231630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:06.434417 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:48:06.434376 2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b49ce45_fbb5_4e4d_bcc0_ba58042d580d.slice/crio-conmon-86e9e63fe94a3905c0044a5b0a51133c8c85d97cf3cdcf7df487ccc384868980.scope\": RecentStats: unable to find data in memory cache]" Jul 28 13:48:06.758821 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.758783 2554 generic.go:356] "Generic (PLEG): container finished" podID="8b49ce45-fbb5-4e4d-bcc0-ba58042d580d" containerID="86e9e63fe94a3905c0044a5b0a51133c8c85d97cf3cdcf7df487ccc384868980" exitCode=0 Jul 28 13:48:06.759030 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.758861 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" event={"ID":"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d","Type":"ContainerDied","Data":"86e9e63fe94a3905c0044a5b0a51133c8c85d97cf3cdcf7df487ccc384868980"} Jul 28 13:48:06.759318 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.759299 2554 scope.go:117] "RemoveContainer" containerID="86e9e63fe94a3905c0044a5b0a51133c8c85d97cf3cdcf7df487ccc384868980" Jul 28 13:48:06.763544 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:06.763519 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:07.764180 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:07.764149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9" event={"ID":"8b49ce45-fbb5-4e4d-bcc0-ba58042d580d","Type":"ContainerStarted","Data":"01e48d794f07096890cac63ad5d06f08385c970474ae2a44c61931fcaede7728"} Jul 28 13:48:10.611856 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:10.611824 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:10.612291 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:10.611909 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:10.616576 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:10.616556 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:10.779452 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:10.779426 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:48:10.834758 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:10.834722 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:48:11.780612 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:11.780576 2554 generic.go:356] "Generic (PLEG): container finished" podID="37ebe66f-7da1-4537-9baa-64fa1f7e06e1" containerID="683a2495121e8fa72e3efaa4193e9e1946c2a2c9a57c605e7bc943d11dc1d3fb" exitCode=0 Jul 28 13:48:11.781035 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:11.780650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" event={"ID":"37ebe66f-7da1-4537-9baa-64fa1f7e06e1","Type":"ContainerDied","Data":"683a2495121e8fa72e3efaa4193e9e1946c2a2c9a57c605e7bc943d11dc1d3fb"} Jul 28 13:48:11.781080 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:11.781034 2554 scope.go:117] "RemoveContainer" containerID="683a2495121e8fa72e3efaa4193e9e1946c2a2c9a57c605e7bc943d11dc1d3fb" Jul 28 13:48:12.785728 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:12.785693 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-fr52v" event={"ID":"37ebe66f-7da1-4537-9baa-64fa1f7e06e1","Type":"ContainerStarted","Data":"917f481c6d2daff8a095e277471559e9b145ff34332b46c21b02ea259d4dfd30"} Jul 28 13:48:21.821591 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:21.821556 2554 generic.go:356] "Generic (PLEG): container finished" podID="923f5579-8b90-4574-8edc-52e337261140" containerID="122c919f913c2b61108c71b8b3b4a11b5965182ad2f89c5167fae9b4e00b41a6" exitCode=0 Jul 28 13:48:21.822129 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:21.821632 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" event={"ID":"923f5579-8b90-4574-8edc-52e337261140","Type":"ContainerDied","Data":"122c919f913c2b61108c71b8b3b4a11b5965182ad2f89c5167fae9b4e00b41a6"} Jul 28 13:48:21.822129 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:21.822111 2554 scope.go:117] "RemoveContainer" containerID="122c919f913c2b61108c71b8b3b4a11b5965182ad2f89c5167fae9b4e00b41a6" Jul 28 13:48:22.828219 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:22.828181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-lpjgw" event={"ID":"923f5579-8b90-4574-8edc-52e337261140","Type":"ContainerStarted","Data":"9de72319f379ab05a4cd3022592a8506be77142f7590bd000d9c8be472005bae"} Jul 28 13:48:35.854043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:35.853994 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8d7c987cd-z545x" podUID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" containerName="console" containerID="cri-o://612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032" gracePeriod=15 Jul 28 13:48:36.095428 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.095404 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:36.279770 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279681 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.279770 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279756 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.280024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279776 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.280024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279807 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg8lc\" (UniqueName: \"kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.280024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.280024 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.279854 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert\") pod \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\" (UID: \"c83bcad8-1469-4b3e-ad69-e324d3faf9f5\") " Jul 28 13:48:36.280228 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.280196 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config" (OuterVolumeSpecName: "console-config") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:48:36.280228 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.280214 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:48:36.280339 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.280240 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:48:36.282136 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.282108 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:48:36.282258 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.282197 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc" (OuterVolumeSpecName: "kube-api-access-bg8lc") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "kube-api-access-bg8lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:48:36.282258 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.282205 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c83bcad8-1469-4b3e-ad69-e324d3faf9f5" (UID: "c83bcad8-1469-4b3e-ad69-e324d3faf9f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:48:36.380749 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380717 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg8lc\" (UniqueName: \"kubernetes.io/projected/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-kube-api-access-bg8lc\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.380749 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380746 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.380928 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380760 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.380928 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380771 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.380928 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380782 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.380928 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.380792 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c83bcad8-1469-4b3e-ad69-e324d3faf9f5-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:48:36.882366 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.882330 2554 generic.go:356] "Generic (PLEG): container finished" podID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" containerID="612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032" exitCode=0 Jul 28 13:48:36.882763 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.882378 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d7c987cd-z545x" Jul 28 13:48:36.882763 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.882419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d7c987cd-z545x" event={"ID":"c83bcad8-1469-4b3e-ad69-e324d3faf9f5","Type":"ContainerDied","Data":"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032"} Jul 28 13:48:36.882763 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.882475 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d7c987cd-z545x" event={"ID":"c83bcad8-1469-4b3e-ad69-e324d3faf9f5","Type":"ContainerDied","Data":"b93c7b675169051c0f19b9c918e8a404f768ba497d7ac1fbbd7ef24f78689415"} Jul 28 13:48:36.882763 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.882505 2554 scope.go:117] "RemoveContainer" containerID="612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032" Jul 28 13:48:36.891329 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.891312 2554 scope.go:117] "RemoveContainer" containerID="612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032" Jul 28 13:48:36.891566 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:48:36.891547 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032\": container with ID starting with 612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032 not found: ID does not exist" containerID="612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032" Jul 28 13:48:36.891624 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.891575 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032"} err="failed to get container status \"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032\": rpc error: code = NotFound desc = could not find container \"612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032\": container with ID starting with 612b2950a3822a0a7ce8a63bec1b9e5e6379f3232fc039a0d7c70d23a4807032 not found: ID does not exist" Jul 28 13:48:36.906361 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.906335 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:48:36.912814 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:36.912793 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8d7c987cd-z545x"] Jul 28 13:48:38.139244 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:48:38.139204 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" path="/var/lib/kubelet/pods/c83bcad8-1469-4b3e-ad69-e324d3faf9f5/volumes" Jul 28 13:49:17.975304 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.975275 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:49:17.975687 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.975547 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" containerName="console" Jul 28 13:49:17.975687 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.975557 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" containerName="console" Jul 28 13:49:17.975687 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.975618 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c83bcad8-1469-4b3e-ad69-e324d3faf9f5" containerName="console" Jul 28 13:49:17.978157 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.978129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:17.992453 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:17.992426 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:49:18.096384 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096345 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcfj9\" (UniqueName: \"kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096564 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.096754 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.096580 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198018 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.197967 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198018 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198075 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198116 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198131 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcfj9\" (UniqueName: \"kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198876 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198884 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.198902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.198895 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.199145 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.199045 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.200594 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.200572 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.200677 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.200636 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.207895 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.207875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcfj9\" (UniqueName: \"kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9\") pod \"console-d89989f5c-sbx22\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.288110 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.288034 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:18.418153 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:18.418126 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:49:18.420248 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:49:18.420221 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e24b07_11ab_460b_8640_9faf3d6627c5.slice/crio-93d67da01534f3f945b26c1cc61a5469b9ae7eb2bd9c145662b509947dff3584 WatchSource:0}: Error finding container 93d67da01534f3f945b26c1cc61a5469b9ae7eb2bd9c145662b509947dff3584: Status 404 returned error can't find the container with id 93d67da01534f3f945b26c1cc61a5469b9ae7eb2bd9c145662b509947dff3584 Jul 28 13:49:19.046698 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:19.046657 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89989f5c-sbx22" event={"ID":"c4e24b07-11ab-460b-8640-9faf3d6627c5","Type":"ContainerStarted","Data":"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0"} Jul 28 13:49:19.047131 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:19.046716 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89989f5c-sbx22" event={"ID":"c4e24b07-11ab-460b-8640-9faf3d6627c5","Type":"ContainerStarted","Data":"93d67da01534f3f945b26c1cc61a5469b9ae7eb2bd9c145662b509947dff3584"} Jul 28 13:49:19.066832 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:19.066748 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d89989f5c-sbx22" podStartSLOduration=2.066729534 podStartE2EDuration="2.066729534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:49:19.065871905 +0000 UTC m=+183.455843113" watchObservedRunningTime="2026-07-28 13:49:19.066729534 +0000 UTC m=+183.456700742" Jul 28 13:49:28.288510 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:28.288474 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:28.288919 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:28.288561 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:28.293284 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:28.293263 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:29.087632 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:29.087601 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:49:29.156826 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:29.156795 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:49:54.177989 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.177928 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c8676dc9d-22cf7" podUID="a1eda7c4-3229-464c-a7ec-40cc4db02559" containerName="console" containerID="cri-o://1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f" gracePeriod=15 Jul 28 13:49:54.429678 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.429623 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:49:54.513626 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513596 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.513806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513652 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.513806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513670 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.513915 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513866 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.513969 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513921 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.513969 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.513954 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpr9v\" (UniqueName: \"kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.514106 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.514012 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:54.514210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.514092 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:54.514324 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.514231 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.514324 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.514248 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:54.515789 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.515763 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:54.515907 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.515883 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:49:54.515965 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.515909 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v" (OuterVolumeSpecName: "kube-api-access-xpr9v") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "kube-api-access-xpr9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:49:54.614513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614483 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config\") pod \"a1eda7c4-3229-464c-a7ec-40cc4db02559\" (UID: \"a1eda7c4-3229-464c-a7ec-40cc4db02559\") " Jul 28 13:49:54.614652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614626 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-trusted-ca-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.614652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614636 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.614652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614646 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.614756 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614654 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpr9v\" (UniqueName: \"kubernetes.io/projected/a1eda7c4-3229-464c-a7ec-40cc4db02559-kube-api-access-xpr9v\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.614756 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614664 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:54.614813 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.614784 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config" (OuterVolumeSpecName: "console-config") pod "a1eda7c4-3229-464c-a7ec-40cc4db02559" (UID: "a1eda7c4-3229-464c-a7ec-40cc4db02559"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:49:54.715344 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:54.715275 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1eda7c4-3229-464c-a7ec-40cc4db02559-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:49:55.178070 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.178018 2554 generic.go:356] "Generic (PLEG): container finished" podID="a1eda7c4-3229-464c-a7ec-40cc4db02559" containerID="1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f" exitCode=0 Jul 28 13:49:55.178070 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.178058 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c8676dc9d-22cf7" Jul 28 13:49:55.178070 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.178079 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8676dc9d-22cf7" event={"ID":"a1eda7c4-3229-464c-a7ec-40cc4db02559","Type":"ContainerDied","Data":"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f"} Jul 28 13:49:55.178592 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.178127 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c8676dc9d-22cf7" event={"ID":"a1eda7c4-3229-464c-a7ec-40cc4db02559","Type":"ContainerDied","Data":"04b40651a85411f8c9ea993b28e1968e0e25cedd5468e9f3ef43806671f9a1d6"} Jul 28 13:49:55.178592 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.178152 2554 scope.go:117] "RemoveContainer" containerID="1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f" Jul 28 13:49:55.186376 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.186355 2554 scope.go:117] "RemoveContainer" containerID="1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f" Jul 28 13:49:55.186627 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:49:55.186608 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f\": container with ID starting with 1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f not found: ID does not exist" containerID="1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f" Jul 28 13:49:55.186695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.186635 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f"} err="failed to get container status \"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f\": rpc error: code = NotFound desc = could not find container \"1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f\": container with ID starting with 1476b248cb66ae7b3332c309bb71425702db11b0ed7b9dc8cdf886bead97709f not found: ID does not exist" Jul 28 13:49:55.199292 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.199267 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:49:55.202902 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:55.202883 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c8676dc9d-22cf7"] Jul 28 13:49:56.140500 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:49:56.140464 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1eda7c4-3229-464c-a7ec-40cc4db02559" path="/var/lib/kubelet/pods/a1eda7c4-3229-464c-a7ec-40cc4db02559/volumes" Jul 28 13:50:29.058953 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.058917 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55bcf46586-8bnz8"] Jul 28 13:50:29.059509 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.059382 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1eda7c4-3229-464c-a7ec-40cc4db02559" containerName="console" Jul 28 13:50:29.059509 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.059398 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1eda7c4-3229-464c-a7ec-40cc4db02559" containerName="console" Jul 28 13:50:29.059509 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.059507 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1eda7c4-3229-464c-a7ec-40cc4db02559" containerName="console" Jul 28 13:50:29.063861 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.063836 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.083576 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.083541 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bcf46586-8bnz8"] Jul 28 13:50:29.167443 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167402 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmswf\" (UniqueName: \"kubernetes.io/projected/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-kube-api-access-jmswf\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167443 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167444 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-trusted-ca-bundle\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167647 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167517 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-service-ca\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167647 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167558 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167647 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-oauth-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167647 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.167647 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.167642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-oauth-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268500 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmswf\" (UniqueName: \"kubernetes.io/projected/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-kube-api-access-jmswf\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268500 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-trusted-ca-bundle\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-service-ca\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-oauth-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.268695 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.268658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-oauth-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.269442 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.269409 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-service-ca\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.269569 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.269411 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-oauth-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.269569 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.269421 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-trusted-ca-bundle\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.269708 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.269678 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.270932 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.270906 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-oauth-config\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.271167 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.271151 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-console-serving-cert\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.277513 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.277492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmswf\" (UniqueName: \"kubernetes.io/projected/1dd58a8b-a272-4394-b03e-5adaa6a7c13b-kube-api-access-jmswf\") pod \"console-55bcf46586-8bnz8\" (UID: \"1dd58a8b-a272-4394-b03e-5adaa6a7c13b\") " pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.372954 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.372909 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:29.514963 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:29.514927 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55bcf46586-8bnz8"] Jul 28 13:50:29.518748 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:50:29.518721 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd58a8b_a272_4394_b03e_5adaa6a7c13b.slice/crio-ab1d37581ba57c4915184c13631d2589d2531d0850b974af7785270c4fee17cf WatchSource:0}: Error finding container ab1d37581ba57c4915184c13631d2589d2531d0850b974af7785270c4fee17cf: Status 404 returned error can't find the container with id ab1d37581ba57c4915184c13631d2589d2531d0850b974af7785270c4fee17cf Jul 28 13:50:30.308345 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:30.308309 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bcf46586-8bnz8" event={"ID":"1dd58a8b-a272-4394-b03e-5adaa6a7c13b","Type":"ContainerStarted","Data":"bf02100a313b90fe9926bb6d190ac61bda676a87ed8b2cfc8b593b1e24c8c65b"} Jul 28 13:50:30.308737 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:30.308357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55bcf46586-8bnz8" event={"ID":"1dd58a8b-a272-4394-b03e-5adaa6a7c13b","Type":"ContainerStarted","Data":"ab1d37581ba57c4915184c13631d2589d2531d0850b974af7785270c4fee17cf"} Jul 28 13:50:30.329838 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:30.329786 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55bcf46586-8bnz8" podStartSLOduration=1.329772059 podStartE2EDuration="1.329772059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:50:30.329004125 +0000 UTC m=+254.718975333" watchObservedRunningTime="2026-07-28 13:50:30.329772059 +0000 UTC m=+254.719743266" Jul 28 13:50:39.373340 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:39.373244 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:39.373340 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:39.373300 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:39.378223 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:39.378200 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:40.347870 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:40.347837 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55bcf46586-8bnz8" Jul 28 13:50:40.409633 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:50:40.409596 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:51:05.430692 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.430651 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d89989f5c-sbx22" podUID="c4e24b07-11ab-460b-8640-9faf3d6627c5" containerName="console" containerID="cri-o://1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0" gracePeriod=15 Jul 28 13:51:05.669610 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.669586 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:51:05.770335 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770229 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770335 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770307 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770345 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770367 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770403 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770449 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcfj9\" (UniqueName: \"kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770567 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770526 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle\") pod \"c4e24b07-11ab-460b-8640-9faf3d6627c5\" (UID: \"c4e24b07-11ab-460b-8640-9faf3d6627c5\") " Jul 28 13:51:05.770834 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770808 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config" (OuterVolumeSpecName: "console-config") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:05.770922 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770895 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:05.770998 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.770892 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:05.771060 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.771013 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:05.772578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.772555 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:51:05.772578 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.772575 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:51:05.772716 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.772657 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9" (OuterVolumeSpecName: "kube-api-access-xcfj9") pod "c4e24b07-11ab-460b-8640-9faf3d6627c5" (UID: "c4e24b07-11ab-460b-8640-9faf3d6627c5"). InnerVolumeSpecName "kube-api-access-xcfj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:51:05.871299 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871245 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-trusted-ca-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871299 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871291 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871299 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871301 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-oauth-config\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871299 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871310 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4e24b07-11ab-460b-8640-9faf3d6627c5-console-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871299 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871320 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-service-ca\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871594 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871328 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4e24b07-11ab-460b-8640-9faf3d6627c5-oauth-serving-cert\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:05.871594 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:05.871337 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcfj9\" (UniqueName: \"kubernetes.io/projected/c4e24b07-11ab-460b-8640-9faf3d6627c5-kube-api-access-xcfj9\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:06.441493 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.441404 2554 generic.go:356] "Generic (PLEG): container finished" podID="c4e24b07-11ab-460b-8640-9faf3d6627c5" containerID="1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0" exitCode=0 Jul 28 13:51:06.441493 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.441451 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89989f5c-sbx22" Jul 28 13:51:06.441935 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.441491 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89989f5c-sbx22" event={"ID":"c4e24b07-11ab-460b-8640-9faf3d6627c5","Type":"ContainerDied","Data":"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0"} Jul 28 13:51:06.441935 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.441544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89989f5c-sbx22" event={"ID":"c4e24b07-11ab-460b-8640-9faf3d6627c5","Type":"ContainerDied","Data":"93d67da01534f3f945b26c1cc61a5469b9ae7eb2bd9c145662b509947dff3584"} Jul 28 13:51:06.441935 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.441572 2554 scope.go:117] "RemoveContainer" containerID="1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0" Jul 28 13:51:06.449769 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.449751 2554 scope.go:117] "RemoveContainer" containerID="1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0" Jul 28 13:51:06.450067 ip-10-0-141-91 kubenswrapper[2554]: E0728 13:51:06.450043 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0\": container with ID starting with 1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0 not found: ID does not exist" containerID="1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0" Jul 28 13:51:06.450135 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.450075 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0"} err="failed to get container status \"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0\": rpc error: code = NotFound desc = could not find container \"1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0\": container with ID starting with 1017e49e1b7348208a9459690cf63e74cadaed41b716bafd38b7d9314fdde8c0 not found: ID does not exist" Jul 28 13:51:06.456879 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.456855 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:51:06.459402 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:06.459382 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d89989f5c-sbx22"] Jul 28 13:51:08.139650 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:08.139612 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e24b07-11ab-460b-8640-9faf3d6627c5" path="/var/lib/kubelet/pods/c4e24b07-11ab-460b-8640-9faf3d6627c5/volumes" Jul 28 13:51:15.989280 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:15.989252 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:51:15.993909 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:15.993883 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:51:16.000083 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:16.000066 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 13:51:20.439702 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.439660 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d"] Jul 28 13:51:20.442144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.440116 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e24b07-11ab-460b-8640-9faf3d6627c5" containerName="console" Jul 28 13:51:20.442144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.440134 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e24b07-11ab-460b-8640-9faf3d6627c5" containerName="console" Jul 28 13:51:20.442144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.440186 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e24b07-11ab-460b-8640-9faf3d6627c5" containerName="console" Jul 28 13:51:20.443124 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.443105 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.446081 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.446065 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 13:51:20.446178 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.446069 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 13:51:20.447215 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.447173 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrqkx\"" Jul 28 13:51:20.454316 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.454293 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d"] Jul 28 13:51:20.482074 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.482040 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.482246 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.482081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.482246 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.482159 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9vv\" (UniqueName: \"kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.583326 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.583283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.583530 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.583340 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.583530 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.583411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9vv\" (UniqueName: \"kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.583752 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.583724 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.583823 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.583732 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.592795 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.592767 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9vv\" (UniqueName: \"kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.752172 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.752066 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:20.886909 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.886770 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d"] Jul 28 13:51:20.889485 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:51:20.889453 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b73fea_78b8_4f57_980a_dc9c072dbd91.slice/crio-3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810 WatchSource:0}: Error finding container 3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810: Status 404 returned error can't find the container with id 3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810 Jul 28 13:51:20.891712 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:20.891698 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:51:21.499143 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:21.499103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" event={"ID":"46b73fea-78b8-4f57-980a-dc9c072dbd91","Type":"ContainerStarted","Data":"3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810"} Jul 28 13:51:27.525693 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:27.525651 2554 generic.go:356] "Generic (PLEG): container finished" podID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerID="de15e0eb4e00d2b6026da10972b4991a740cac4f1510f6bb338d47ff471fc0f4" exitCode=0 Jul 28 13:51:27.526103 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:27.525744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" event={"ID":"46b73fea-78b8-4f57-980a-dc9c072dbd91","Type":"ContainerDied","Data":"de15e0eb4e00d2b6026da10972b4991a740cac4f1510f6bb338d47ff471fc0f4"} Jul 28 13:51:29.534857 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:29.534828 2554 generic.go:356] "Generic (PLEG): container finished" podID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerID="e476fcc50a0fb786b689b7f306e8dd17d3c34a99bfbcf67a11a4127e65430e24" exitCode=0 Jul 28 13:51:29.535212 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:29.534866 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" event={"ID":"46b73fea-78b8-4f57-980a-dc9c072dbd91","Type":"ContainerDied","Data":"e476fcc50a0fb786b689b7f306e8dd17d3c34a99bfbcf67a11a4127e65430e24"} Jul 28 13:51:36.567890 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:36.567854 2554 generic.go:356] "Generic (PLEG): container finished" podID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerID="17aa0d033e16b2db3866b742230c093ea8a2712c6fcc5a8f01cf8969666869f8" exitCode=0 Jul 28 13:51:36.568360 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:36.567942 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" event={"ID":"46b73fea-78b8-4f57-980a-dc9c072dbd91","Type":"ContainerDied","Data":"17aa0d033e16b2db3866b742230c093ea8a2712c6fcc5a8f01cf8969666869f8"} Jul 28 13:51:37.703759 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.703734 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:37.803121 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.803085 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle\") pod \"46b73fea-78b8-4f57-980a-dc9c072dbd91\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " Jul 28 13:51:37.803307 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.803152 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9vv\" (UniqueName: \"kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv\") pod \"46b73fea-78b8-4f57-980a-dc9c072dbd91\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " Jul 28 13:51:37.803307 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.803192 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util\") pod \"46b73fea-78b8-4f57-980a-dc9c072dbd91\" (UID: \"46b73fea-78b8-4f57-980a-dc9c072dbd91\") " Jul 28 13:51:37.803758 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.803728 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle" (OuterVolumeSpecName: "bundle") pod "46b73fea-78b8-4f57-980a-dc9c072dbd91" (UID: "46b73fea-78b8-4f57-980a-dc9c072dbd91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:51:37.805377 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.805343 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv" (OuterVolumeSpecName: "kube-api-access-pt9vv") pod "46b73fea-78b8-4f57-980a-dc9c072dbd91" (UID: "46b73fea-78b8-4f57-980a-dc9c072dbd91"). InnerVolumeSpecName "kube-api-access-pt9vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:51:37.807594 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.807575 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util" (OuterVolumeSpecName: "util") pod "46b73fea-78b8-4f57-980a-dc9c072dbd91" (UID: "46b73fea-78b8-4f57-980a-dc9c072dbd91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:51:37.903906 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.903872 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:37.903906 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.903901 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9vv\" (UniqueName: \"kubernetes.io/projected/46b73fea-78b8-4f57-980a-dc9c072dbd91-kube-api-access-pt9vv\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:37.903906 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:37.903911 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b73fea-78b8-4f57-980a-dc9c072dbd91-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:51:38.577196 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:38.577164 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" Jul 28 13:51:38.577196 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:38.577187 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pwg5d" event={"ID":"46b73fea-78b8-4f57-980a-dc9c072dbd91","Type":"ContainerDied","Data":"3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810"} Jul 28 13:51:38.577406 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:38.577236 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d9f4861b43c73cc97505b7b812adbc8c4fd23fffcd0f7b2d6859f1711643810" Jul 28 13:51:43.736775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.736738 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq"] Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737061 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="pull" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737073 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="pull" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737083 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="extract" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737089 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="extract" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737099 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="util" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737105 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="util" Jul 28 13:51:43.737179 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.737155 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b73fea-78b8-4f57-980a-dc9c072dbd91" containerName="extract" Jul 28 13:51:43.780439 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.780409 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq"] Jul 28 13:51:43.780592 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.780504 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.783494 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.783471 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 13:51:43.783874 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.783853 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:51:43.783963 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.783895 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dbb8s\"" Jul 28 13:51:43.853764 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.853730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvtv\" (UniqueName: \"kubernetes.io/projected/be091b74-6da8-4b40-8a45-d89cf70c313d-kube-api-access-bwvtv\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.853910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.853785 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be091b74-6da8-4b40-8a45-d89cf70c313d-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.954376 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.954342 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvtv\" (UniqueName: \"kubernetes.io/projected/be091b74-6da8-4b40-8a45-d89cf70c313d-kube-api-access-bwvtv\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.954533 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.954391 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be091b74-6da8-4b40-8a45-d89cf70c313d-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.954756 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.954739 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be091b74-6da8-4b40-8a45-d89cf70c313d-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:43.963831 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:43.963802 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvtv\" (UniqueName: \"kubernetes.io/projected/be091b74-6da8-4b40-8a45-d89cf70c313d-kube-api-access-bwvtv\") pod \"cert-manager-operator-controller-manager-56b4598547-9msnq\" (UID: \"be091b74-6da8-4b40-8a45-d89cf70c313d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:44.090147 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:44.090112 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" Jul 28 13:51:44.250946 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:44.250918 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq"] Jul 28 13:51:44.253969 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:51:44.253945 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe091b74_6da8_4b40_8a45_d89cf70c313d.slice/crio-7eb7b62777cca55d461a09b3ff0e7c59761acca0eda993eb2ef9e42794d762ed WatchSource:0}: Error finding container 7eb7b62777cca55d461a09b3ff0e7c59761acca0eda993eb2ef9e42794d762ed: Status 404 returned error can't find the container with id 7eb7b62777cca55d461a09b3ff0e7c59761acca0eda993eb2ef9e42794d762ed Jul 28 13:51:44.600637 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:44.600602 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" event={"ID":"be091b74-6da8-4b40-8a45-d89cf70c313d","Type":"ContainerStarted","Data":"7eb7b62777cca55d461a09b3ff0e7c59761acca0eda993eb2ef9e42794d762ed"} Jul 28 13:51:46.610960 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:46.610921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" event={"ID":"be091b74-6da8-4b40-8a45-d89cf70c313d","Type":"ContainerStarted","Data":"74b426d154f6d1394fca95996b6535b0737c921ee691612740764a01a1cd310b"} Jul 28 13:51:46.635157 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:51:46.635107 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-9msnq" podStartSLOduration=1.647723079 podStartE2EDuration="3.635092971s" totalImagesPullingTime="1.987369892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:51:46.632731983 +0000 UTC m=+331.022703190" watchObservedRunningTime="2026-07-28 13:51:46.635092971 +0000 UTC m=+331.025064178" Jul 28 13:52:00.122445 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.122406 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npwfh"] Jul 28 13:52:00.124572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.124552 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.127235 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.127211 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 13:52:00.128148 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.128131 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 13:52:00.128240 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.128136 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-td4tx\"" Jul 28 13:52:00.145779 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.145748 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npwfh"] Jul 28 13:52:00.188609 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.188572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-bound-sa-token\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.188775 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.188643 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcf7\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-kube-api-access-twcf7\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.289949 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.289911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-bound-sa-token\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.290099 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.289999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcf7\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-kube-api-access-twcf7\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.299476 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.299438 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-bound-sa-token\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.299600 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.299571 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcf7\" (UniqueName: \"kubernetes.io/projected/5dd9aec0-5145-464d-8862-d3e1b9d7f37b-kube-api-access-twcf7\") pod \"cert-manager-55b4d954d5-npwfh\" (UID: \"5dd9aec0-5145-464d-8862-d3e1b9d7f37b\") " pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.443547 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.443452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npwfh" Jul 28 13:52:00.573581 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.573488 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npwfh"] Jul 28 13:52:00.576068 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:52:00.576030 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd9aec0_5145_464d_8862_d3e1b9d7f37b.slice/crio-8b6207e6b776559f625e61b6f7d900e8647400a19cf87a695ed9feb1a2f10efb WatchSource:0}: Error finding container 8b6207e6b776559f625e61b6f7d900e8647400a19cf87a695ed9feb1a2f10efb: Status 404 returned error can't find the container with id 8b6207e6b776559f625e61b6f7d900e8647400a19cf87a695ed9feb1a2f10efb Jul 28 13:52:00.675310 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:00.675277 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npwfh" event={"ID":"5dd9aec0-5145-464d-8862-d3e1b9d7f37b","Type":"ContainerStarted","Data":"8b6207e6b776559f625e61b6f7d900e8647400a19cf87a695ed9feb1a2f10efb"} Jul 28 13:52:03.692420 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:03.692384 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npwfh" event={"ID":"5dd9aec0-5145-464d-8862-d3e1b9d7f37b","Type":"ContainerStarted","Data":"cfbb9cb3251c5780c6bc0ba8cfbb261aaa583681b306258aa1e0c1bac90c2577"} Jul 28 13:52:03.708983 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:03.708928 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-npwfh" podStartSLOduration=1.170529016 podStartE2EDuration="3.708911808s" totalImagesPullingTime="2.538382792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:52:03.708602163 +0000 UTC m=+348.098573372" watchObservedRunningTime="2026-07-28 13:52:03.708911808 +0000 UTC m=+348.098883014" Jul 28 13:52:04.114302 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.114268 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4"] Jul 28 13:52:04.116572 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.116556 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.119274 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.119251 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 13:52:04.119412 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.119334 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 13:52:04.119412 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.119338 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qrqkx\"" Jul 28 13:52:04.126910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.126889 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4"] Jul 28 13:52:04.221667 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.221626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.221667 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.221659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhl5\" (UniqueName: \"kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.221910 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.221759 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.323253 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.323213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.323253 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.323254 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhl5\" (UniqueName: \"kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.323462 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.323311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.323703 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.323682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.323744 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.323692 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.332329 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.332304 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhl5\" (UniqueName: \"kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.425616 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.425527 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:04.554652 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.554627 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4"] Jul 28 13:52:04.557255 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:52:04.557231 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e27944_4e20_4f30_bf2d_96c7108872ba.slice/crio-45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90 WatchSource:0}: Error finding container 45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90: Status 404 returned error can't find the container with id 45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90 Jul 28 13:52:04.697644 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.697556 2554 generic.go:356] "Generic (PLEG): container finished" podID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerID="c3cf3fb1acc93e480f7aee8e44c4eb9e3e88b50729c9e903280c49029b6798f8" exitCode=0 Jul 28 13:52:04.698045 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.697646 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" event={"ID":"63e27944-4e20-4f30-bf2d-96c7108872ba","Type":"ContainerDied","Data":"c3cf3fb1acc93e480f7aee8e44c4eb9e3e88b50729c9e903280c49029b6798f8"} Jul 28 13:52:04.698045 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:04.697712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" event={"ID":"63e27944-4e20-4f30-bf2d-96c7108872ba","Type":"ContainerStarted","Data":"45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90"} Jul 28 13:52:07.717222 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:07.717182 2554 generic.go:356] "Generic (PLEG): container finished" podID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerID="14d5432967fc7cd5c63b1f8f3bd8e0286c2efabd9187c1db218e00cddf787cec" exitCode=0 Jul 28 13:52:07.717659 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:07.717268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" event={"ID":"63e27944-4e20-4f30-bf2d-96c7108872ba","Type":"ContainerDied","Data":"14d5432967fc7cd5c63b1f8f3bd8e0286c2efabd9187c1db218e00cddf787cec"} Jul 28 13:52:08.723184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:08.723104 2554 generic.go:356] "Generic (PLEG): container finished" podID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerID="62284df7f195d706736fabedee97ddb51256ffb54b476dcfef483dfabfb66ce4" exitCode=0 Jul 28 13:52:08.723184 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:08.723159 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" event={"ID":"63e27944-4e20-4f30-bf2d-96c7108872ba","Type":"ContainerDied","Data":"62284df7f195d706736fabedee97ddb51256ffb54b476dcfef483dfabfb66ce4"} Jul 28 13:52:09.849818 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.849794 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:09.974445 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.974414 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util\") pod \"63e27944-4e20-4f30-bf2d-96c7108872ba\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " Jul 28 13:52:09.974624 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.974460 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkhl5\" (UniqueName: \"kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5\") pod \"63e27944-4e20-4f30-bf2d-96c7108872ba\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " Jul 28 13:52:09.974624 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.974583 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle\") pod \"63e27944-4e20-4f30-bf2d-96c7108872ba\" (UID: \"63e27944-4e20-4f30-bf2d-96c7108872ba\") " Jul 28 13:52:09.974950 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.974930 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle" (OuterVolumeSpecName: "bundle") pod "63e27944-4e20-4f30-bf2d-96c7108872ba" (UID: "63e27944-4e20-4f30-bf2d-96c7108872ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:52:09.976490 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.976471 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5" (OuterVolumeSpecName: "kube-api-access-hkhl5") pod "63e27944-4e20-4f30-bf2d-96c7108872ba" (UID: "63e27944-4e20-4f30-bf2d-96c7108872ba"). InnerVolumeSpecName "kube-api-access-hkhl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:52:09.980803 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:09.980742 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util" (OuterVolumeSpecName: "util") pod "63e27944-4e20-4f30-bf2d-96c7108872ba" (UID: "63e27944-4e20-4f30-bf2d-96c7108872ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:52:10.076027 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.075969 2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-util\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:52:10.076027 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.076023 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhl5\" (UniqueName: \"kubernetes.io/projected/63e27944-4e20-4f30-bf2d-96c7108872ba-kube-api-access-hkhl5\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:52:10.076027 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.076036 2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63e27944-4e20-4f30-bf2d-96c7108872ba-bundle\") on node \"ip-10-0-141-91.ec2.internal\" DevicePath \"\"" Jul 28 13:52:10.733411 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.733371 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" event={"ID":"63e27944-4e20-4f30-bf2d-96c7108872ba","Type":"ContainerDied","Data":"45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90"} Jul 28 13:52:10.733411 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.733408 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78edvth4" Jul 28 13:52:10.733633 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:10.733419 2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45b5b9852b06e7cc0403bf0d71e97b5d6539dcdab6031b5530806abefaa04e90" Jul 28 13:52:30.575935 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.575900 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5"] Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576196 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="util" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576207 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="util" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576228 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="extract" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576233 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="extract" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576245 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="pull" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576251 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="pull" Jul 28 13:52:30.576426 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.576298 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e27944-4e20-4f30-bf2d-96c7108872ba" containerName="extract" Jul 28 13:52:30.580155 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.580138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.582963 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.582939 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 28 13:52:30.583109 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.583050 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:52:30.583998 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.583965 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 28 13:52:30.584106 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.584005 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 28 13:52:30.584253 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.584239 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 28 13:52:30.584332 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.584314 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-j2lzh\"" Jul 28 13:52:30.590726 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.590694 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5"] Jul 28 13:52:30.740953 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.740914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-metrics-certs\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.741144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.740962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfck5\" (UniqueName: \"kubernetes.io/projected/e9695d9d-006d-4dac-a82b-cd9d2ad10182-kube-api-access-hfck5\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.741144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.741046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9695d9d-006d-4dac-a82b-cd9d2ad10182-manager-config\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.741144 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.741104 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-cert\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.841730 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.841628 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-cert\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.841730 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.841695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-metrics-certs\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.841730 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.841719 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfck5\" (UniqueName: \"kubernetes.io/projected/e9695d9d-006d-4dac-a82b-cd9d2ad10182-kube-api-access-hfck5\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.842032 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.841752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9695d9d-006d-4dac-a82b-cd9d2ad10182-manager-config\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.842486 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.842462 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e9695d9d-006d-4dac-a82b-cd9d2ad10182-manager-config\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.844227 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.844201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-metrics-certs\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.844382 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.844362 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9695d9d-006d-4dac-a82b-cd9d2ad10182-cert\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.850145 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.850122 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfck5\" (UniqueName: \"kubernetes.io/projected/e9695d9d-006d-4dac-a82b-cd9d2ad10182-kube-api-access-hfck5\") pod \"jobset-controller-manager-548585bb9c-k4rs5\" (UID: \"e9695d9d-006d-4dac-a82b-cd9d2ad10182\") " pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:30.890679 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:30.890626 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:31.024063 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:31.023988 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5"] Jul 28 13:52:31.026670 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:52:31.026641 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9695d9d_006d_4dac_a82b_cd9d2ad10182.slice/crio-46ae73927f8f77c70cbb237d9fe180ffc28b4bf2fc31bee39ee31eb0a7fdb98e WatchSource:0}: Error finding container 46ae73927f8f77c70cbb237d9fe180ffc28b4bf2fc31bee39ee31eb0a7fdb98e: Status 404 returned error can't find the container with id 46ae73927f8f77c70cbb237d9fe180ffc28b4bf2fc31bee39ee31eb0a7fdb98e Jul 28 13:52:31.835152 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:31.835105 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" event={"ID":"e9695d9d-006d-4dac-a82b-cd9d2ad10182","Type":"ContainerStarted","Data":"46ae73927f8f77c70cbb237d9fe180ffc28b4bf2fc31bee39ee31eb0a7fdb98e"} Jul 28 13:52:33.844792 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:33.844761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" event={"ID":"e9695d9d-006d-4dac-a82b-cd9d2ad10182","Type":"ContainerStarted","Data":"4882bf08921e02c571349a976e088431fb7d492eb62a00cc666e8bf4eb39302f"} Jul 28 13:52:33.845210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:33.844842 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:52:33.866568 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:33.866525 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" podStartSLOduration=1.415438688 podStartE2EDuration="3.866511934s" totalImagesPullingTime="2.451073246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:52:33.865442183 +0000 UTC m=+378.255413390" watchObservedRunningTime="2026-07-28 13:52:33.866511934 +0000 UTC m=+378.256483144" Jul 28 13:52:44.855129 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:52:44.855098 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-548585bb9c-k4rs5" Jul 28 13:53:45.069036 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:45.068941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2w4qv_21382e6a-33e2-412a-9f0e-996c44b89351/global-pull-secret-syncer/0.log" Jul 28 13:53:45.253065 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:45.253034 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f9zpj_0949ff00-521c-489c-a074-8893c4c1b993/konnectivity-agent/0.log" Jul 28 13:53:45.355897 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:45.355866 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-91.ec2.internal_22e3722b3da67d4e99a57997b921b163/haproxy/0.log" Jul 28 13:53:49.032352 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:49.032328 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-7lms4_ca60e8c9-dd6e-42ce-9d19-4d8477c357f7/cluster-monitoring-operator/0.log" Jul 28 13:53:49.228164 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:49.228080 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mssnf_a1aa01f5-0977-4d60-b486-90b19734a78a/node-exporter/0.log" Jul 28 13:53:49.256133 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:49.256097 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mssnf_a1aa01f5-0977-4d60-b486-90b19734a78a/kube-rbac-proxy/0.log" Jul 28 13:53:49.288068 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:49.288042 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mssnf_a1aa01f5-0977-4d60-b486-90b19734a78a/init-textfile/0.log" Jul 28 13:53:51.546359 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:51.546327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-lptr4_7bde103d-5ef7-4369-beec-6b0a5f769ce0/networking-console-plugin/0.log" Jul 28 13:53:52.003272 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.003212 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/2.log" Jul 28 13:53:52.010600 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.010565 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-kj86r_e15d794e-19a1-4f0e-8f0a-df7b37cdd634/console-operator/3.log" Jul 28 13:53:52.397640 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.397600 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55bcf46586-8bnz8_1dd58a8b-a272-4394-b03e-5adaa6a7c13b/console/0.log" Jul 28 13:53:52.686256 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.686175 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv"] Jul 28 13:53:52.689747 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.689724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.692333 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.692304 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ng2n9\"/\"default-dockercfg-bh9hw\"" Jul 28 13:53:52.693374 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.693355 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ng2n9\"/\"kube-root-ca.crt\"" Jul 28 13:53:52.693516 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.693450 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ng2n9\"/\"openshift-service-ca.crt\"" Jul 28 13:53:52.698617 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.698593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv"] Jul 28 13:53:52.836388 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.836343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-lib-modules\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.836606 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.836406 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-sys\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.836606 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.836481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7f6m\" (UniqueName: \"kubernetes.io/projected/b8986222-c7ae-4b60-8ad0-a28e502536e5-kube-api-access-d7f6m\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.836606 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.836529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-proc\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.836606 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.836583 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-podres\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937280 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-sys\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937280 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7f6m\" (UniqueName: \"kubernetes.io/projected/b8986222-c7ae-4b60-8ad0-a28e502536e5-kube-api-access-d7f6m\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937312 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-sys\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-proc\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937382 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-podres\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937435 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-proc\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937472 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-lib-modules\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937562 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937527 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-podres\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.937765 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.937594 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8986222-c7ae-4b60-8ad0-a28e502536e5-lib-modules\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.953933 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.953912 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7f6m\" (UniqueName: \"kubernetes.io/projected/b8986222-c7ae-4b60-8ad0-a28e502536e5-kube-api-access-d7f6m\") pod \"perf-node-gather-daemonset-djxlv\" (UID: \"b8986222-c7ae-4b60-8ad0-a28e502536e5\") " pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:52.964581 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:52.964551 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-2mzg9_de2e5964-10cc-4568-a249-12c857ccabbb/volume-data-source-validator/0.log" Jul 28 13:53:53.000616 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.000592 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:53.130194 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.130170 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv"] Jul 28 13:53:53.132259 ip-10-0-141-91 kubenswrapper[2554]: W0728 13:53:53.132237 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8986222_c7ae_4b60_8ad0_a28e502536e5.slice/crio-6e5a6b08f48d2475bb0257d87364eb8b12de477b6f5bebf936ccd98363c79cef WatchSource:0}: Error finding container 6e5a6b08f48d2475bb0257d87364eb8b12de477b6f5bebf936ccd98363c79cef: Status 404 returned error can't find the container with id 6e5a6b08f48d2475bb0257d87364eb8b12de477b6f5bebf936ccd98363c79cef Jul 28 13:53:53.211942 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.211877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" event={"ID":"b8986222-c7ae-4b60-8ad0-a28e502536e5","Type":"ContainerStarted","Data":"832d0d2cc42f1c79c17af19e281da7385030f27c625765bd04b7cf801d65f747"} Jul 28 13:53:53.211942 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.211925 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" event={"ID":"b8986222-c7ae-4b60-8ad0-a28e502536e5","Type":"ContainerStarted","Data":"6e5a6b08f48d2475bb0257d87364eb8b12de477b6f5bebf936ccd98363c79cef"} Jul 28 13:53:53.212118 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.211997 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:53:53.230410 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.230369 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" podStartSLOduration=1.230355753 podStartE2EDuration="1.230355753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:53:53.229899093 +0000 UTC m=+457.619870301" watchObservedRunningTime="2026-07-28 13:53:53.230355753 +0000 UTC m=+457.620326978" Jul 28 13:53:53.802250 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.802220 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ld4m9_76d03a97-ae81-4f43-8587-e8f185ab2a41/dns/0.log" Jul 28 13:53:53.889557 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:53.889530 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ld4m9_76d03a97-ae81-4f43-8587-e8f185ab2a41/kube-rbac-proxy/0.log" Jul 28 13:53:54.100234 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:54.100202 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sqj4g_6c4841ce-8f2c-43ac-a4fb-c3da29cd236f/dns-node-resolver/0.log" Jul 28 13:53:54.493806 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:54.493707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6474cf9d66-hp9k9_6ccc8a9b-cfa3-4565-bbec-e0ef513699c0/registry/0.log" Jul 28 13:53:54.567968 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:54.567926 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jkmrc_5eae876f-cc9a-42a9-a66d-6fad0520fc77/node-ca/0.log" Jul 28 13:53:55.438740 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:55.438711 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-866dc68ffc-g4w7d_9bdc4799-efa6-4173-b9cd-31f86f5daa89/router/0.log" Jul 28 13:53:55.782668 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:55.782589 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8pt4s_45f38503-dc90-4dde-ad36-c07e7894a3a2/serve-healthcheck-canary/0.log" Jul 28 13:53:56.165886 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:56.165849 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-lpjgw_923f5579-8b90-4574-8edc-52e337261140/insights-operator/1.log" Jul 28 13:53:56.176315 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:56.176283 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-lpjgw_923f5579-8b90-4574-8edc-52e337261140/insights-operator/0.log" Jul 28 13:53:56.276579 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:56.276547 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcp9m_ee14a513-9e77-4d02-b6e1-ba4ea9cc1207/kube-rbac-proxy/0.log" Jul 28 13:53:56.298637 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:56.298612 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcp9m_ee14a513-9e77-4d02-b6e1-ba4ea9cc1207/exporter/0.log" Jul 28 13:53:56.323318 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:56.323293 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gcp9m_ee14a513-9e77-4d02-b6e1-ba4ea9cc1207/extractor/0.log" Jul 28 13:53:57.921722 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:57.921694 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-548585bb9c-k4rs5_e9695d9d-006d-4dac-a82b-cd9d2ad10182/manager/0.log" Jul 28 13:53:59.225689 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:53:59.225660 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ng2n9/perf-node-gather-daemonset-djxlv" Jul 28 13:54:01.127493 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:01.127461 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-88pjb_f53c078b-8b81-4a6f-b30c-ba48ad5e1721/migrator/0.log" Jul 28 13:54:01.157213 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:01.157183 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-88pjb_f53c078b-8b81-4a6f-b30c-ba48ad5e1721/graceful-termination/0.log" Jul 28 13:54:01.556356 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:01.556327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9_8b49ce45-fbb5-4e4d-bcc0-ba58042d580d/kube-storage-version-migrator-operator/1.log" Jul 28 13:54:01.557681 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:01.557660 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-j7cg9_8b49ce45-fbb5-4e4d-bcc0-ba58042d580d/kube-storage-version-migrator-operator/0.log" Jul 28 13:54:02.625751 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.625669 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4prm2_e898eb0a-6831-4f1a-a2e2-b3017623fc39/kube-multus/0.log" Jul 28 13:54:02.866822 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.866792 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/kube-multus-additional-cni-plugins/0.log" Jul 28 13:54:02.892796 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.892728 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/egress-router-binary-copy/0.log" Jul 28 13:54:02.916679 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.916655 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/cni-plugins/0.log" Jul 28 13:54:02.940478 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.940445 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/bond-cni-plugin/0.log" Jul 28 13:54:02.964790 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.964763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/routeoverride-cni/0.log" Jul 28 13:54:02.988518 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:02.988492 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/whereabouts-cni-bincopy/0.log" Jul 28 13:54:03.013731 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:03.013711 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4pm8w_0cb490d4-9ef9-4952-9fc6-2b25ed3403ba/whereabouts-cni/0.log" Jul 28 13:54:03.291729 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:03.291692 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n5546_8fb47319-a07f-41ae-b273-5e100eed0f4f/network-metrics-daemon/0.log" Jul 28 13:54:03.315210 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:03.315188 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n5546_8fb47319-a07f-41ae-b273-5e100eed0f4f/kube-rbac-proxy/0.log" Jul 28 13:54:04.726378 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.726339 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/ovn-controller/0.log" Jul 28 13:54:04.746117 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.746091 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/ovn-acl-logging/0.log" Jul 28 13:54:04.775102 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.775077 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/kube-rbac-proxy-node/0.log" Jul 28 13:54:04.797964 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.797937 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 13:54:04.820859 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.820825 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/northd/0.log" Jul 28 13:54:04.849801 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.849762 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/nbdb/0.log" Jul 28 13:54:04.872637 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.872609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/sbdb/0.log" Jul 28 13:54:04.930357 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:04.930334 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8l6c5_8a6f00e0-9a1c-4aea-9eec-8e8204ec2856/ovnkube-controller/0.log" Jul 28 13:54:05.900043 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:05.900012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-rp8sv_41c88b10-3a3a-40c3-a011-76801745eeca/check-endpoints/0.log" Jul 28 13:54:05.978638 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:05.978612 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xbjrs_ad9408d2-46a8-4b0b-812b-14a220b8c26d/network-check-target-container/0.log" Jul 28 13:54:07.075864 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:07.075834 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ncq86_df346386-76f9-4bf2-ab1e-3941c73abeda/iptables-alerter/0.log" Jul 28 13:54:07.868738 ip-10-0-141-91 kubenswrapper[2554]: I0728 13:54:07.868689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dh8lm_8373ee1d-2e45-4cc0-b58e-117849f3c24c/tuned/0.log"