Jul 29 10:20:11.475866 ip-10-0-128-91 systemd[1]: Starting Kubernetes Kubelet... Jul 29 10:20:11.907788 ip-10-0-128-91 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:20:11.907788 ip-10-0-128-91 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 10:20:11.907788 ip-10-0-128-91 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:20:11.907788 ip-10-0-128-91 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 10:20:11.907788 ip-10-0-128-91 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 10:20:11.908475 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.907847 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 10:20:11.912454 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912434 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.912454 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912450 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.912454 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912454 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.912454 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912459 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.912454 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912463 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912467 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912471 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912474 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912477 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912479 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912482 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912485 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912487 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912490 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912493 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912495 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912498 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912500 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912503 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912505 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912511 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912513 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912516 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912519 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.912664 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912521 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912524 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912526 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912529 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912531 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912534 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912537 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912539 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912542 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912544 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912547 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912549 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912568 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912573 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912576 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912580 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912582 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912585 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912587 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912590 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.913139 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912592 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912595 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912598 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912601 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912603 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912606 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912609 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912611 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912614 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912617 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912619 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912624 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912628 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912631 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912634 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912637 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912640 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912642 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912645 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.913649 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912647 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912650 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912652 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912655 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912658 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912662 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912665 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912668 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912671 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912674 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912676 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912679 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912682 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912684 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912687 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912690 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912692 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912695 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912697 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.914160 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912701 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912706 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912709 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912712 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912715 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912718 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912721 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912724 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912727 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912730 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912732 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912734 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912737 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912739 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912742 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912745 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.912747 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913434 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913441 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.914657 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913444 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913448 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913451 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913453 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913456 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913459 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913461 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913466 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913470 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913473 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913476 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913479 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913482 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913485 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913489 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913492 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913495 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913498 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913500 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913503 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.915115 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913505 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913508 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913510 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913513 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913517 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913521 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913524 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913527 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913529 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913532 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913534 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913537 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913540 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913543 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913545 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913548 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913550 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913570 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913575 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.915625 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913578 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913582 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913585 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913588 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913590 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913593 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913596 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913598 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913601 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913604 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913607 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913610 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913612 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913615 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913617 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913620 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913622 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913625 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913628 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913631 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.916090 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913634 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913637 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913639 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913642 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913645 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913647 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913650 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913653 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913655 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913658 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913661 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913663 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913668 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913671 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913674 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913676 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913679 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913681 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913684 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.916592 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913686 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913689 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913692 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913695 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913698 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913700 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913703 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913705 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913708 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913711 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913714 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913717 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913720 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913722 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913725 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913727 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913730 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913732 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.913735 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914101 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.917177 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914106 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914109 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914111 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914114 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914117 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914119 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914122 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914125 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914127 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914130 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914132 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914135 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914137 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914140 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914142 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914145 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914148 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914151 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914155 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.917678 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914158 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914161 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914165 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914168 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914172 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914175 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914179 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914181 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914184 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914186 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914189 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914191 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914194 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914196 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914198 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914201 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914203 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914206 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914209 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914211 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.918140 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914213 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914216 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914219 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914221 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914224 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914226 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914228 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914231 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914234 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914237 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914239 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914241 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914244 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914246 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914249 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914251 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914254 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914257 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914260 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914262 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.918655 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914266 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914269 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914272 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914276 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914278 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914281 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914284 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914286 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914288 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914291 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914293 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914296 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914298 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914300 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914303 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914305 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914308 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914310 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914313 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914315 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.919173 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914318 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914320 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914323 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914325 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914328 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914330 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914333 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914336 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914339 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914341 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914344 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914346 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914348 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914351 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914353 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914356 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914358 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914362 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.914365 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914438 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 10:20:11.919666 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914447 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914456 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914463 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914469 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914473 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914477 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914484 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914487 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914490 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914493 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914497 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914500 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914503 2558 flags.go:64] FLAG: --cgroup-root="" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914505 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914508 2558 flags.go:64] FLAG: --client-ca-file="" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914512 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914519 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914523 2558 flags.go:64] FLAG: --cluster-domain="" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914526 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914529 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914532 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914536 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914539 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 10:20:11.920152 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914542 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914546 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914549 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914564 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914568 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914571 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914574 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914577 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914581 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914584 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914587 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914591 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914593 2558 flags.go:64] FLAG: --enable-server="true" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914596 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914601 2558 flags.go:64] FLAG: --event-burst="100" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914604 2558 flags.go:64] FLAG: --event-qps="50" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914607 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914610 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914612 2558 flags.go:64] FLAG: --eviction-hard="" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914616 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914619 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914622 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914625 2558 flags.go:64] FLAG: --eviction-soft="" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914628 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914631 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 10:20:11.920724 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914635 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914638 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914641 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914644 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914647 2558 flags.go:64] FLAG: --feature-gates="" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914651 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914654 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914657 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914660 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914663 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914666 2558 flags.go:64] FLAG: --help="false" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914669 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-128-91.ec2.internal" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914673 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914675 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914678 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914682 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914685 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914688 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914691 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914693 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914696 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914699 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914702 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914705 2558 flags.go:64] FLAG: --kube-reserved="" Jul 29 10:20:11.921767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914708 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914711 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914714 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914716 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914719 2558 flags.go:64] FLAG: --lock-file="" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914722 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914725 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914728 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914734 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914737 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914740 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914743 2558 flags.go:64] FLAG: --logging-format="text" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914747 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914750 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914753 2558 flags.go:64] FLAG: --manifest-url="" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914756 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914760 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914763 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914767 2558 flags.go:64] FLAG: --max-pods="110" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914770 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914773 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914776 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914778 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914781 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914784 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 10:20:11.922815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914787 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914794 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914797 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914800 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914803 2558 flags.go:64] FLAG: --pod-cidr="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914806 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914811 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914814 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914817 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914820 2558 flags.go:64] FLAG: --port="10250" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914823 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914826 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e2e4f39b7af5b3c" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914829 2558 flags.go:64] FLAG: --qos-reserved="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914832 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914835 2558 flags.go:64] FLAG: --register-node="true" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914838 2558 flags.go:64] FLAG: --register-with-taints="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914842 2558 flags.go:64] FLAG: --registry-burst="10" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914846 2558 flags.go:64] FLAG: --registry-qps="5" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914849 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914854 2558 flags.go:64] FLAG: --reserved-memory="" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914857 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914860 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914863 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914866 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914869 2558 flags.go:64] FLAG: --runonce="false" Jul 29 10:20:11.923808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914872 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914874 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914877 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914881 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914883 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914886 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914889 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914892 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914895 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914898 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914900 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914904 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914907 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914909 2558 flags.go:64] FLAG: --system-cgroups="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914912 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914917 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914920 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914923 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914927 2558 flags.go:64] FLAG: --tls-min-version="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914929 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914932 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914935 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914938 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914941 2558 flags.go:64] FLAG: --v="2" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914945 2558 flags.go:64] FLAG: --version="false" Jul 29 10:20:11.924519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914950 2558 flags.go:64] FLAG: --vmodule="" Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914955 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.914958 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915068 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915072 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915075 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915078 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915080 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915083 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915086 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915088 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915091 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915095 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915099 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915102 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915105 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915107 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915110 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915113 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915117 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.925686 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915121 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915123 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915126 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915129 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915132 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915134 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915137 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915139 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915142 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915145 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915149 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915152 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915154 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915161 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915164 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915166 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915169 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915172 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915174 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915177 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.926288 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915179 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915182 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915184 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915187 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915189 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915192 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915194 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915197 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915199 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915202 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915204 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915207 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915210 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915212 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915215 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915217 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915220 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915222 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915225 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915228 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.927147 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915230 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915233 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915237 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915240 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915242 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915246 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915249 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915252 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915254 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915257 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915259 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915262 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915264 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915267 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915269 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915273 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915277 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915280 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915282 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.927853 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915285 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915288 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915290 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915293 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915296 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915298 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915300 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915303 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915305 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915308 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915311 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915313 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915316 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915318 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915321 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915325 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915328 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915331 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915335 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915338 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.928436 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915341 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915343 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.915346 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.915954 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.923509 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.923532 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.924295 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.924310 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924394 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924402 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924408 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924413 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924417 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924422 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.928985 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924427 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924431 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924435 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924439 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924444 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924448 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924453 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924457 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924461 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924466 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924470 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924474 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924478 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924483 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924487 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924491 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924496 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924500 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924505 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924509 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.929359 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924513 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924517 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924522 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924526 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924531 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924534 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924541 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924547 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924571 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924577 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924582 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924586 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924591 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924596 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924601 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924605 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924610 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924614 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924618 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924623 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.929977 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924627 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924632 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924637 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924642 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924646 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924650 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924655 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924661 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924666 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924672 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924677 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924682 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924687 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924691 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924695 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924700 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924704 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924708 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924713 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924717 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.930506 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924721 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924725 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924730 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924734 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924738 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924742 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924746 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924751 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924755 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924759 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924763 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924768 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924772 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924776 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924780 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924784 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924788 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924793 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924797 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.931078 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924801 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924805 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924809 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924813 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924817 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924822 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924826 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924830 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924834 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924839 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924843 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924847 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924853 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.924858 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.931840 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.924867 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925033 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925043 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925047 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925052 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925056 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925061 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925065 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925070 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925074 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925079 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925083 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925087 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925091 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925095 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925099 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925104 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925108 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925112 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925116 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 10:20:11.932421 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925120 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925124 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925129 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925133 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925138 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925142 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925146 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925150 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925154 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925158 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925162 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925166 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925170 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925174 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925179 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925182 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925187 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925191 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925195 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925199 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 10:20:11.933274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925203 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925207 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925211 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925215 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925220 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925224 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925228 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925232 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925237 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925241 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925245 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925248 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925252 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925257 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925261 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925265 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925270 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925274 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925278 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925282 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 10:20:11.934166 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925287 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925291 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925295 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925299 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925305 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925311 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925316 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925323 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925328 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925332 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925337 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925341 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925346 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925350 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925354 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925358 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925362 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925366 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925369 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 10:20:11.934789 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925374 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925379 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925385 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925389 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925394 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925398 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925402 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925406 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925410 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925415 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925419 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925424 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925428 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925432 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925436 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925441 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925445 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925449 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925453 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 10:20:11.935274 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925457 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:11.925461 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.925469 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.925624 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.928097 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.929314 2558 server.go:1019] "Starting client certificate rotation" Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.929420 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.930142 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 10:20:11.935790 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.931837 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:20:11.938521 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.938501 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 10:20:11.951822 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.951804 2558 log.go:25] "Validated CRI v1 runtime API" Jul 29 10:20:11.953795 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.953780 2558 log.go:25] "Validated CRI v1 image API" Jul 29 10:20:11.954659 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.954617 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 10:20:11.959180 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.959162 2558 fs.go:135] Filesystem UUIDs: map[4ddcc4ca-a201-4baa-850d-061eb1a7b35d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 87c4d925-247b-47b2-a2fb-0b59897ec3da:/dev/nvme0n1p4] Jul 29 10:20:11.959230 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.959181 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 10:20:11.960226 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.960206 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:20:11.964312 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.964208 2558 manager.go:216] Machine: {Timestamp:2026-07-29 10:20:11.962853849 +0000 UTC m=+0.362105743 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093312 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290f75bfab13665a91210d2e8f6b5e SystemUUID:ec290f75-bfab-1366-5a91-210d2e8f6b5e BootID:788d6203-c33b-4935-9db0-0b47d19f0cf5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:6f:15:a7:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:6f:15:a7:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:81:10:36:83:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 10:20:11.964312 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.964307 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 10:20:11.964417 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.964378 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 10:20:11.967666 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.967642 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 10:20:11.967831 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.967669 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-91.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 10:20:11.968351 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.968340 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 10:20:11.968401 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.968356 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 10:20:11.968401 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.968366 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:20:11.968911 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.968899 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 10:20:11.969846 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.969834 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 10:20:11.972332 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972319 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:20:11.972456 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972445 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 10:20:11.972522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972482 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 29 10:20:11.972522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972497 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 10:20:11.972522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972517 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 10:20:11.972673 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972530 2558 kubelet.go:398] "Adding apiserver pod source" Jul 29 10:20:11.972673 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972542 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 10:20:11.973007 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.972986 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:20:11.973068 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.973016 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 10:20:11.977696 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.977680 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 10:20:11.981355 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.981233 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 10:20:11.981355 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.981283 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 10:20:11.982649 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982630 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 10:20:11.982649 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982651 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982657 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982663 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982672 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982678 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982686 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982691 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982698 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982704 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982712 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 10:20:11.982763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.982718 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 10:20:11.983248 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.983239 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 10:20:11.983248 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.983248 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 10:20:11.983483 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:11.983462 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 10:20:11.983483 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:11.983467 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 10:20:11.986230 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.986216 2558 server.go:1268] "Started kubelet" Jul 29 10:20:11.986308 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.986290 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 10:20:11.986359 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.986297 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 10:20:11.986426 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.986362 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 10:20:11.987180 ip-10-0-128-91 systemd[1]: Started Kubernetes Kubelet. Jul 29 10:20:11.987755 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.987709 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwjnf" Jul 29 10:20:11.988022 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.988003 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 10:20:11.988353 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.988340 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 29 10:20:11.993758 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.993740 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-91.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 10:20:11.995082 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:11.995061 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 10:20:11.995726 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:11.993626 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-91.ec2.internal.18c6bb74a6b0cb8c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-91.ec2.internal,UID:ip-10-0-128-91.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-91.ec2.internal,},FirstTimestamp:2026-07-29 10:20:11.9861851 +0000 UTC m=+0.385436990,LastTimestamp:2026-07-29 10:20:11.9861851 +0000 UTC m=+0.385436990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-91.ec2.internal,}" Jul 29 10:20:11.996684 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.996671 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 10:20:11.996742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.996687 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 10:20:11.996804 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:11.996774 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:11.997549 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997533 2558 factory.go:55] Registering systemd factory Jul 29 10:20:11.997549 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997551 2558 factory.go:223] Registration of the systemd container factory successfully Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997817 2558 factory.go:153] Registering CRI-O factory Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997852 2558 factory.go:223] Registration of the crio container factory successfully Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997901 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997933 2558 factory.go:103] Registering Raw factory Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997945 2558 manager.go:1196] Started watching for new ooms in manager Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997950 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 10:20:11.997982 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.997966 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 10:20:11.998325 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.998102 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 29 10:20:11.998325 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.998111 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 29 10:20:11.998325 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.998213 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 10:20:11.998777 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.998758 2558 manager.go:349] Starting recovery of all containers Jul 29 10:20:11.999675 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:11.999653 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwjnf" Jul 29 10:20:12.002436 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.002414 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-91.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 10:20:12.002512 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.002435 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 10:20:12.010966 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.010824 2558 manager.go:354] Recovery completed Jul 29 10:20:12.014825 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.014812 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:12.020824 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.020807 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:12.020893 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.020836 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:12.020893 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.020846 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:12.021322 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.021309 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 10:20:12.021322 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.021321 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 10:20:12.021418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.021323 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:12.021418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.021338 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 29 10:20:12.023727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023710 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:12.023805 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023735 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:12.023805 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023744 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:12.023966 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023949 2558 policy_none.go:49] "None policy: Start" Jul 29 10:20:12.023966 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023967 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 10:20:12.024061 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.023978 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 10:20:12.025979 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.025968 2558 policy_none.go:47] "Start" Jul 29 10:20:12.067118 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067101 2558 manager.go:337] "Starting Device Plugin manager" Jul 29 10:20:12.067228 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.067148 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 10:20:12.067228 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067162 2558 server.go:87] "Starting device plugin registration server" Jul 29 10:20:12.067461 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067444 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 10:20:12.067573 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067463 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 10:20:12.067620 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067569 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 10:20:12.067691 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067678 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 10:20:12.067691 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.067691 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 10:20:12.068279 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.068259 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 10:20:12.068348 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.068313 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:12.128186 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.128154 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 10:20:12.130238 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.129225 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 10:20:12.130238 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.129274 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 10:20:12.130238 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.129305 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 10:20:12.130238 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:12.129346 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 10:20:12.131851 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:12.131834 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:13.605229 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.605175 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:13.606235 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.606208 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:13.606329 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.606240 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:13.606329 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.606254 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:13.606329 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.606277 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.613909 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.613891 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.613968 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.613911 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-91.ec2.internal\": node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:13.634745 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.634725 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:13.666730 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.666706 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal"] Jul 29 10:20:13.666823 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.666771 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:13.669685 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.669669 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:13.669766 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.669695 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:13.669766 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.669705 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:13.672058 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672046 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:13.672188 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.672228 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672206 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:13.672808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672790 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:13.672808 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672807 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:13.672940 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672818 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:13.672940 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672826 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:13.672940 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672828 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:13.672940 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.672836 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:13.675049 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.675033 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.675105 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.675058 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 10:20:13.675746 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.675730 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientMemory" Jul 29 10:20:13.675806 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.675762 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 10:20:13.675806 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.675776 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeHasSufficientPID" Jul 29 10:20:13.698366 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.698349 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-91.ec2.internal\" not found" node="ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.702526 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.702509 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-91.ec2.internal\" not found" node="ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.735751 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.735729 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:13.736872 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.736857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e077154bb05e2b438a55ffc9093c1eb7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"e077154bb05e2b438a55ffc9093c1eb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.737299 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.737285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.737341 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.737310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.836038 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.836006 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:13.838182 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.838235 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e077154bb05e2b438a55ffc9093c1eb7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"e077154bb05e2b438a55ffc9093c1eb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.838235 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838209 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.838301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.838301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838260 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d73d2e969ea74e387bf4db8ebe5c1fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal\" (UID: \"5d73d2e969ea74e387bf4db8ebe5c1fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.838301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:13.838276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e077154bb05e2b438a55ffc9093c1eb7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-91.ec2.internal\" (UID: \"e077154bb05e2b438a55ffc9093c1eb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:13.936840 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:13.936757 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.002100 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.002079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:14.005767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.005752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:14.037236 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.037203 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.137784 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.137738 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.238403 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.238321 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.304553 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.304528 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:14.338970 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.338938 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.366226 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.366211 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 10:20:14.366767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.366333 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:20:14.366767 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.366360 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 10:20:14.439268 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.439243 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.442306 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.442270 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 10:15:13 +0000 UTC" deadline="2028-03-30 10:40:49.316991965 +0000 UTC" Jul 29 10:20:14.442306 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.442304 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14640h20m34.874690462s" Jul 29 10:20:14.540348 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.540279 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.588716 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.587263 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:14.641057 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.641025 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.674347 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:14.674316 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode077154bb05e2b438a55ffc9093c1eb7.slice/crio-e5d11093b8de91930b3e4edb142334c0d1a8f272a83d8ad3db2db0b6dd7fb16a WatchSource:0}: Error finding container e5d11093b8de91930b3e4edb142334c0d1a8f272a83d8ad3db2db0b6dd7fb16a: Status 404 returned error can't find the container with id e5d11093b8de91930b3e4edb142334c0d1a8f272a83d8ad3db2db0b6dd7fb16a Jul 29 10:20:14.674735 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:14.674721 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d73d2e969ea74e387bf4db8ebe5c1fd.slice/crio-772ce4ef0ab9497664970bcea97d1b432d824aa3e6c576bc5e94526363a4ff84 WatchSource:0}: Error finding container 772ce4ef0ab9497664970bcea97d1b432d824aa3e6c576bc5e94526363a4ff84: Status 404 returned error can't find the container with id 772ce4ef0ab9497664970bcea97d1b432d824aa3e6c576bc5e94526363a4ff84 Jul 29 10:20:14.678366 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.678347 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:20:14.741664 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:14.741632 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-91.ec2.internal\" not found" Jul 29 10:20:14.766495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.766472 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:14.834936 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.834839 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" Jul 29 10:20:14.849316 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.849296 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:20:14.850160 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.850146 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" Jul 29 10:20:14.858591 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:14.858575 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 10:20:15.411275 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.411245 2558 apiserver.go:52] "Watching apiserver" Jul 29 10:20:15.424664 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.424636 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 10:20:15.425119 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.425094 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8tjk2","kube-system/global-pull-secret-syncer-f6lcd","kube-system/konnectivity-agent-qmxrv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal","openshift-multus/multus-additional-cni-plugins-mw2j8","openshift-network-diagnostics/network-check-target-kxwzp","openshift-ovn-kubernetes/ovnkube-node-flwzb","kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l2v9k","openshift-dns/node-resolver-kkppp","openshift-image-registry/node-ca-rwxhg","openshift-multus/multus-qr2zg","openshift-multus/network-metrics-daemon-895ll"] Jul 29 10:20:15.427775 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.427512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:15.427775 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.427591 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:15.429662 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.429626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.432458 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.432167 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.433051 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.433030 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.433184 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.433170 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.433377 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.433356 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rwsdx\"" Jul 29 10:20:15.434231 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.434210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.434503 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.434480 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 10:20:15.435271 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.435254 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zg6lb\"" Jul 29 10:20:15.435607 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.435590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 10:20:15.435692 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.435679 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 10:20:15.436362 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.436338 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.436447 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.436409 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:15.436993 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.436975 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.437075 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.437030 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.437135 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.436975 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bmjf4\"" Jul 29 10:20:15.437216 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.437200 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 10:20:15.438804 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.438783 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.441188 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.441170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.441580 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.441379 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.441657 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.441633 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vv4kb\"" Jul 29 10:20:15.441763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.441742 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 10:20:15.442072 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.442055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.442301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.442281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 10:20:15.442461 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.442445 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 10:20:15.443815 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.443795 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.444743 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.444760 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dabb725-7bca-4cc7-bbb1-255b95c820c9-konnectivity-ca\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.444803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.444846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.444889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-hosts-file\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjzcw\" (UniqueName: \"kubernetes.io/projected/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-kube-api-access-xjzcw\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdhfq\" (UniqueName: \"kubernetes.io/projected/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-kube-api-access-wdhfq\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445142 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-device-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-tmp-dir\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445370 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dabb725-7bca-4cc7-bbb1-255b95c820c9-agent-certs\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.445623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.445439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hgc6\" (UniqueName: \"kubernetes.io/projected/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kube-api-access-5hgc6\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.447165 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.446653 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 10:20:15.447165 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.446772 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 10:20:15.447165 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.446908 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wlps9\"" Jul 29 10:20:15.448923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.447641 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 10:20:15.448923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.447694 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8z9j4\"" Jul 29 10:20:15.448923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.448015 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 10:20:15.448923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.448126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.448923 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.448206 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:15.449971 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.449953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.450229 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.449961 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 10:20:15.452033 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.452011 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.452254 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.452237 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vnqbp\"" Jul 29 10:20:15.452344 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.452301 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.452658 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.452642 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.454935 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.454863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.455534 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.455228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.455534 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.455479 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.455534 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.455501 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 10:20:15.455783 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.455572 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9cmcl\"" Jul 29 10:20:15.457017 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.456998 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 10:20:15.457278 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.457261 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 10:20:15.457571 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.457550 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtdmf\"" Jul 29 10:20:15.457746 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.457561 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 10:20:15.468515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.468492 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6khbx" Jul 29 10:20:15.476301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.476281 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6khbx" Jul 29 10:20:15.537193 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.537169 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 10:20:15.545728 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-lib-modules\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.545849 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdhfq\" (UniqueName: \"kubernetes.io/projected/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-kube-api-access-wdhfq\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.545849 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29664a2f-cbb6-421a-abd1-1700a502dcd8-host\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.545849 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-tmp-dir\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.545849 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-host-slash\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.545849 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-os-release\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-log-socket\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.546064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-host\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.546064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.545967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.546064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-multus\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-dbus\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.546234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546064 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-etc-selinux\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.546234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.546234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-conf\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.546234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546144 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:15.546234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjzcw\" (UniqueName: \"kubernetes.io/projected/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-kube-api-access-xjzcw\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-tmp-dir\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-socket-dir-parent\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-etc-kubernetes\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29664a2f-cbb6-421a-abd1-1700a502dcd8-serviceca\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-iptables-alerter-script\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.546396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-system-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-hostroot\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-var-lib-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-etc-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-systemd\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-run\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6957v\" (UniqueName: \"kubernetes.io/projected/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-kube-api-access-6957v\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546624 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-systemd-units\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546655 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lchs\" (UniqueName: \"kubernetes.io/projected/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-kube-api-access-4lchs\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-system-cni-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.546742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-os-release\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.547217 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.546744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.547286 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-netns\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j5wq\" (UniqueName: \"kubernetes.io/projected/bf84ffdf-c678-453a-a765-8f167b90ce68-kube-api-access-4j5wq\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.547338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-ovn\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547409 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-env-overrides\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547409 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e3994ee-1701-458b-b35d-cc15970abb28-ovn-node-metrics-cert\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547409 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-systemd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547409 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547476 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-sys-fs\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547475 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.547569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-netns\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-conf-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-device-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547622 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-kubelet\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-var-lib-kubelet\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547685 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-device-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.547779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-config\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-kubelet-config\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysconfig\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hgc6\" (UniqueName: \"kubernetes.io/projected/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kube-api-access-5hgc6\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-k8s-cni-cncf-io\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-daemon-config\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.547977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-bin\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548045 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-hosts-file\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-multus-certs\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-kubelet\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-slash\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-kubernetes\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548174 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-tmp\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-node-log\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-script-lib\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.548338 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-hosts-file\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548438 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-registration-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cni-binary-copy\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-netd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqqt\" (UniqueName: \"kubernetes.io/projected/9e3994ee-1701-458b-b35d-cc15970abb28-kube-api-access-dgqqt\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548543 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-socket-dir\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dabb725-7bca-4cc7-bbb1-255b95c820c9-agent-certs\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.548523 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-cnibin\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.548643 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.548628 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:16.048607753 +0000 UTC m=+3.010538359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cnibin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-bin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-modprobe-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-sys\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-tuned\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54mmx\" (UniqueName: \"kubernetes.io/projected/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-kube-api-access-54mmx\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.549096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.548845 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 10:20:15.549392 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.549214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dabb725-7bca-4cc7-bbb1-255b95c820c9-konnectivity-ca\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.549392 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.549274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjsc\" (UniqueName: \"kubernetes.io/projected/29664a2f-cbb6-421a-abd1-1700a502dcd8-kube-api-access-5cjsc\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.549392 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.549306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.549915 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.549891 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6dabb725-7bca-4cc7-bbb1-255b95c820c9-konnectivity-ca\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.552953 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.552829 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6dabb725-7bca-4cc7-bbb1-255b95c820c9-agent-certs\") pod \"konnectivity-agent-qmxrv\" (UID: \"6dabb725-7bca-4cc7-bbb1-255b95c820c9\") " pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.553304 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.553286 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:15.553304 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.553305 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:15.553426 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.553315 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:15.553426 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.553358 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:16.053340508 +0000 UTC m=+3.015271094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:15.555447 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.555415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdhfq\" (UniqueName: \"kubernetes.io/projected/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-kube-api-access-wdhfq\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:15.555868 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.555824 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjzcw\" (UniqueName: \"kubernetes.io/projected/af893ee0-5ee0-4dd8-92de-815dd0a3bd96-kube-api-access-xjzcw\") pod \"node-resolver-kkppp\" (UID: \"af893ee0-5ee0-4dd8-92de-815dd0a3bd96\") " pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.557003 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.556982 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hgc6\" (UniqueName: \"kubernetes.io/projected/2c49a19e-066f-4f1f-b920-4e5dac9d2ba7-kube-api-access-5hgc6\") pod \"aws-ebs-csi-driver-node-krxpb\" (UID: \"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.570607 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.570552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"5d73d2e969ea74e387bf4db8ebe5c1fd","Type":"ContainerStarted","Data":"772ce4ef0ab9497664970bcea97d1b432d824aa3e6c576bc5e94526363a4ff84"} Jul 29 10:20:15.571592 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.571568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" event={"ID":"e077154bb05e2b438a55ffc9093c1eb7","Type":"ContainerStarted","Data":"e5d11093b8de91930b3e4edb142334c0d1a8f272a83d8ad3db2db0b6dd7fb16a"} Jul 29 10:20:15.650438 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-iptables-alerter-script\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.650438 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-system-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-hostroot\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-var-lib-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-var-lib-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650549 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-system-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-hostroot\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-etc-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-systemd\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-run\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.650678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650675 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-etc-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6957v\" (UniqueName: \"kubernetes.io/projected/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-kube-api-access-6957v\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-systemd-units\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650728 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-run\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650713 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-systemd\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lchs\" (UniqueName: \"kubernetes.io/projected/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-kube-api-access-4lchs\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-system-cni-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-os-release\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-netns\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j5wq\" (UniqueName: \"kubernetes.io/projected/bf84ffdf-c678-453a-a765-8f167b90ce68-kube-api-access-4j5wq\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-ovn\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650933 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-systemd-units\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-env-overrides\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.650983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e3994ee-1701-458b-b35d-cc15970abb28-ovn-node-metrics-cert\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-systemd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651036 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-system-cni-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.651143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651051 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-iptables-alerter-script\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651095 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-netns\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651100 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-ovn\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-netns\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-conf-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-kubelet\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651207 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-var-lib-kubelet\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651304 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-kubelet\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-config\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-kubelet-config\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-netns\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysconfig\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-k8s-cni-cncf-io\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-daemon-config\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651442 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-var-lib-kubelet\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651462 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-systemd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-bin\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651484 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-multus-certs\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651531 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-multus-certs\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-kubelet\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651545 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-os-release\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-slash\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-kubernetes\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651590 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysconfig\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651594 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-kubelet-config\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651591 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-run-openvswitch\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-cni-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-tmp\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.652760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651396 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-conf-dir\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651633 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-kubelet\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651649 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-env-overrides\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651663 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651668 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-slash\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651702 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-run-ovn-kubernetes\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-run-k8s-cni-cncf-io\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651699 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-bin\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-node-log\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651762 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-kubernetes\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-script-lib\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651867 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-node-log\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.651872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652107 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-config\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652445 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-daemon-config\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652468 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e3994ee-1701-458b-b35d-cc15970abb28-ovnkube-script-lib\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.653910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cni-binary-copy\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652473 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-cni-binary-copy\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-netd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652576 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-host-cni-netd\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqqt\" (UniqueName: \"kubernetes.io/projected/9e3994ee-1701-458b-b35d-cc15970abb28-kube-api-access-dgqqt\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-cnibin\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cnibin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-bin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652705 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bf84ffdf-c678-453a-a765-8f167b90ce68-cnibin\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652759 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cnibin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652795 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-bin\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-modprobe-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-sys\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-tuned\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.652983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54mmx\" (UniqueName: \"kubernetes.io/projected/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-kube-api-access-54mmx\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653007 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-modprobe-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjsc\" (UniqueName: \"kubernetes.io/projected/29664a2f-cbb6-421a-abd1-1700a502dcd8-kube-api-access-5cjsc\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653031 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-cni-binary-copy\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.654727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-lib-modules\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653098 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-sys\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653140 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29664a2f-cbb6-421a-abd1-1700a502dcd8-host\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653139 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bf84ffdf-c678-453a-a765-8f167b90ce68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29664a2f-cbb6-421a-abd1-1700a502dcd8-host\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-host-slash\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653194 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-d\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-os-release\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-log-socket\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653239 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-host-slash\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653243 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-lib-modules\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-host\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653282 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-multus\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653293 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e3994ee-1701-458b-b35d-cc15970abb28-log-socket\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653307 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-dbus\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653293 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-os-release\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-host\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.655587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653337 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-host-var-lib-cni-multus\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-conf\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.653408 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-socket-dir-parent\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653429 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c6c9065c-0112-490a-876a-2ad60639d743-dbus\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-etc-kubernetes\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:15.653464 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:16.153445762 +0000 UTC m=+3.115376350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-multus-socket-dir-parent\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653477 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-etc-kubernetes\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653491 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29664a2f-cbb6-421a-abd1-1700a502dcd8-serviceca\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653510 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-sysctl-conf\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.653918 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29664a2f-cbb6-421a-abd1-1700a502dcd8-serviceca\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.654250 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-tmp\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.654285 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e3994ee-1701-458b-b35d-cc15970abb28-ovn-node-metrics-cert\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.656495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.655432 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-etc-tuned\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.663245 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.663186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjsc\" (UniqueName: \"kubernetes.io/projected/29664a2f-cbb6-421a-abd1-1700a502dcd8-kube-api-access-5cjsc\") pod \"node-ca-rwxhg\" (UID: \"29664a2f-cbb6-421a-abd1-1700a502dcd8\") " pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.663245 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.663192 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lchs\" (UniqueName: \"kubernetes.io/projected/6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce-kube-api-access-4lchs\") pod \"iptables-alerter-8tjk2\" (UID: \"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce\") " pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.663506 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.663484 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqqt\" (UniqueName: \"kubernetes.io/projected/9e3994ee-1701-458b-b35d-cc15970abb28-kube-api-access-dgqqt\") pod \"ovnkube-node-flwzb\" (UID: \"9e3994ee-1701-458b-b35d-cc15970abb28\") " pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.663861 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.663840 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54mmx\" (UniqueName: \"kubernetes.io/projected/e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a-kube-api-access-54mmx\") pod \"tuned-l2v9k\" (UID: \"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a\") " pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.664039 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.664022 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6957v\" (UniqueName: \"kubernetes.io/projected/2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d-kube-api-access-6957v\") pod \"multus-qr2zg\" (UID: \"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d\") " pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.664098 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.664024 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j5wq\" (UniqueName: \"kubernetes.io/projected/bf84ffdf-c678-453a-a765-8f167b90ce68-kube-api-access-4j5wq\") pod \"multus-additional-cni-plugins-mw2j8\" (UID: \"bf84ffdf-c678-453a-a765-8f167b90ce68\") " pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.742697 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.742628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkppp" Jul 29 10:20:15.752404 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.752381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:15.760814 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.760793 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" Jul 29 10:20:15.768386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.768365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8tjk2" Jul 29 10:20:15.776981 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.776964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" Jul 29 10:20:15.783683 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.783665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:15.791342 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.791322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qr2zg" Jul 29 10:20:15.798011 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.797985 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" Jul 29 10:20:15.802494 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.802473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rwxhg" Jul 29 10:20:15.833591 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:15.833571 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:16.056134 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.056047 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:16.056134 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.056131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056223 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056254 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056278 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056289 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056312 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:17.056295889 +0000 UTC m=+4.018226474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:16.056334 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.056331 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:17.056320615 +0000 UTC m=+4.018251201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:16.066936 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.066909 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 10:20:16.156779 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.156743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:16.156941 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.156918 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:16.156999 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.156989 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:17.156973231 +0000 UTC m=+4.118903817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:16.480054 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.479972 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:15:15 +0000 UTC" deadline="2028-01-15 12:21:26.648339096 +0000 UTC" Jul 29 10:20:16.480054 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.480013 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12842h1m10.168328335s" Jul 29 10:20:16.498474 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.498445 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf84ffdf_c678_453a_a765_8f167b90ce68.slice/crio-65168ce7860819516f462aed17a815d0b2af8d91eb9e0c4bce26da10abee3130 WatchSource:0}: Error finding container 65168ce7860819516f462aed17a815d0b2af8d91eb9e0c4bce26da10abee3130: Status 404 returned error can't find the container with id 65168ce7860819516f462aed17a815d0b2af8d91eb9e0c4bce26da10abee3130 Jul 29 10:20:16.500170 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.500145 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa0e7c1_a926_4fc2_9fdc_b3a74adf76ce.slice/crio-35cf2f2adbe64e6e986e80c599ed678189c4133eb06ff6ff39606622d3388062 WatchSource:0}: Error finding container 35cf2f2adbe64e6e986e80c599ed678189c4133eb06ff6ff39606622d3388062: Status 404 returned error can't find the container with id 35cf2f2adbe64e6e986e80c599ed678189c4133eb06ff6ff39606622d3388062 Jul 29 10:20:16.500892 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.500852 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc5c9e1_4fb9_4e4c_b79c_83afca1a5a6d.slice/crio-f635e9a99bff2975f191901422985aab4e375fac65a9f1639b1d9f5f039fbf39 WatchSource:0}: Error finding container f635e9a99bff2975f191901422985aab4e375fac65a9f1639b1d9f5f039fbf39: Status 404 returned error can't find the container with id f635e9a99bff2975f191901422985aab4e375fac65a9f1639b1d9f5f039fbf39 Jul 29 10:20:16.504461 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.504442 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c49a19e_066f_4f1f_b920_4e5dac9d2ba7.slice/crio-2cb751edb002ba257a9851852fc110f38794cab15509f4bd4f2d559745cf131e WatchSource:0}: Error finding container 2cb751edb002ba257a9851852fc110f38794cab15509f4bd4f2d559745cf131e: Status 404 returned error can't find the container with id 2cb751edb002ba257a9851852fc110f38794cab15509f4bd4f2d559745cf131e Jul 29 10:20:16.524621 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.524597 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3994ee_1701_458b_b35d_cc15970abb28.slice/crio-1c7852d38ad2f317f679aed25bf7f9f74948cd58d18c6c91191af60f40b2d224 WatchSource:0}: Error finding container 1c7852d38ad2f317f679aed25bf7f9f74948cd58d18c6c91191af60f40b2d224: Status 404 returned error can't find the container with id 1c7852d38ad2f317f679aed25bf7f9f74948cd58d18c6c91191af60f40b2d224 Jul 29 10:20:16.525830 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.525803 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dabb725_7bca_4cc7_bbb1_255b95c820c9.slice/crio-62e43ce0c18a712809b14402a044487d62cdfa73d76b4f62689165bcf43ea9ae WatchSource:0}: Error finding container 62e43ce0c18a712809b14402a044487d62cdfa73d76b4f62689165bcf43ea9ae: Status 404 returned error can't find the container with id 62e43ce0c18a712809b14402a044487d62cdfa73d76b4f62689165bcf43ea9ae Jul 29 10:20:16.526738 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.526712 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b6bfab_0ef8_4bb6_a6ab_2f854e60e42a.slice/crio-1aa480ee4cfb6a205de28bfe4334315a1e4f540b886d3b2cbfb381332d825e78 WatchSource:0}: Error finding container 1aa480ee4cfb6a205de28bfe4334315a1e4f540b886d3b2cbfb381332d825e78: Status 404 returned error can't find the container with id 1aa480ee4cfb6a205de28bfe4334315a1e4f540b886d3b2cbfb381332d825e78 Jul 29 10:20:16.527778 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.527467 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf893ee0_5ee0_4dd8_92de_815dd0a3bd96.slice/crio-3680e690fdde9bc371175cd1ed1f3c4fb61ff1f0206b3d27f189a856ad376f86 WatchSource:0}: Error finding container 3680e690fdde9bc371175cd1ed1f3c4fb61ff1f0206b3d27f189a856ad376f86: Status 404 returned error can't find the container with id 3680e690fdde9bc371175cd1ed1f3c4fb61ff1f0206b3d27f189a856ad376f86 Jul 29 10:20:16.528652 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:16.528573 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29664a2f_cbb6_421a_abd1_1700a502dcd8.slice/crio-e90b7cc19c9004a414ed310737df9ddc3cca2847868a103dceb65089052e59ad WatchSource:0}: Error finding container e90b7cc19c9004a414ed310737df9ddc3cca2847868a103dceb65089052e59ad: Status 404 returned error can't find the container with id e90b7cc19c9004a414ed310737df9ddc3cca2847868a103dceb65089052e59ad Jul 29 10:20:16.568013 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.567866 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:16.568135 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:16.568107 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:16.576022 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.575999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkppp" event={"ID":"af893ee0-5ee0-4dd8-92de-815dd0a3bd96","Type":"ContainerStarted","Data":"3680e690fdde9bc371175cd1ed1f3c4fb61ff1f0206b3d27f189a856ad376f86"} Jul 29 10:20:16.576977 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.576948 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmxrv" event={"ID":"6dabb725-7bca-4cc7-bbb1-255b95c820c9","Type":"ContainerStarted","Data":"62e43ce0c18a712809b14402a044487d62cdfa73d76b4f62689165bcf43ea9ae"} Jul 29 10:20:16.578026 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.578006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"1c7852d38ad2f317f679aed25bf7f9f74948cd58d18c6c91191af60f40b2d224"} Jul 29 10:20:16.579800 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.579771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qr2zg" event={"ID":"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d","Type":"ContainerStarted","Data":"f635e9a99bff2975f191901422985aab4e375fac65a9f1639b1d9f5f039fbf39"} Jul 29 10:20:16.581487 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.581453 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8tjk2" event={"ID":"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce","Type":"ContainerStarted","Data":"35cf2f2adbe64e6e986e80c599ed678189c4133eb06ff6ff39606622d3388062"} Jul 29 10:20:16.583061 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.583042 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerStarted","Data":"65168ce7860819516f462aed17a815d0b2af8d91eb9e0c4bce26da10abee3130"} Jul 29 10:20:16.584100 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.584082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rwxhg" event={"ID":"29664a2f-cbb6-421a-abd1-1700a502dcd8","Type":"ContainerStarted","Data":"e90b7cc19c9004a414ed310737df9ddc3cca2847868a103dceb65089052e59ad"} Jul 29 10:20:16.585218 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.585196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" event={"ID":"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a","Type":"ContainerStarted","Data":"1aa480ee4cfb6a205de28bfe4334315a1e4f540b886d3b2cbfb381332d825e78"} Jul 29 10:20:16.586313 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:16.586293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" event={"ID":"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7","Type":"ContainerStarted","Data":"2cb751edb002ba257a9851852fc110f38794cab15509f4bd4f2d559745cf131e"} Jul 29 10:20:17.063328 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.063290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:17.063489 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.063364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:17.063563 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.063494 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:17.063622 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.063565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:19.063544935 +0000 UTC m=+6.025475540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:17.064115 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.064004 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:17.064115 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.064026 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:17.064115 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.064038 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:17.064115 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.064082 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:19.064067304 +0000 UTC m=+6.025997890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:17.164620 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.164058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:17.164620 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.164206 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:17.164620 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.164266 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:19.164249747 +0000 UTC m=+6.126180337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:17.480589 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.480499 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 10:15:15 +0000 UTC" deadline="2028-03-01 01:24:41.896373204 +0000 UTC" Jul 29 10:20:17.480589 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.480543 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13935h4m24.41583566s" Jul 29 10:20:17.570387 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.570356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:17.570552 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.570485 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:17.570895 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.570858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:17.570997 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:17.570968 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:17.609534 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.609498 2558 generic.go:356] "Generic (PLEG): container finished" podID="5d73d2e969ea74e387bf4db8ebe5c1fd" containerID="1a5d1ae1eccf9dc98a19f347ec5c83d57067c9e290950c1f6294fe39b1f2317b" exitCode=0 Jul 29 10:20:17.609691 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.609595 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"5d73d2e969ea74e387bf4db8ebe5c1fd","Type":"ContainerDied","Data":"1a5d1ae1eccf9dc98a19f347ec5c83d57067c9e290950c1f6294fe39b1f2317b"} Jul 29 10:20:17.630896 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:17.630656 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" event={"ID":"e077154bb05e2b438a55ffc9093c1eb7","Type":"ContainerStarted","Data":"651200a01d216f2b15f30d0a1576e9bd2648bd9fdbffd85e18682a0b16d35f21"} Jul 29 10:20:18.567310 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:18.567270 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:18.567778 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:18.567431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:18.646986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:18.646947 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" event={"ID":"5d73d2e969ea74e387bf4db8ebe5c1fd","Type":"ContainerStarted","Data":"3fcbe452fb2722f3bfc7017c34b4bdcfa5975f5d3beb585249d174b28e3fe3d9"} Jul 29 10:20:18.667342 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:18.667279 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-91.ec2.internal" podStartSLOduration=4.667259825 podStartE2EDuration="4.667259825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:17.664236568 +0000 UTC m=+4.626167178" watchObservedRunningTime="2026-07-29 10:20:18.667259825 +0000 UTC m=+5.629190436" Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:19.083139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:19.083210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083327 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083386 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:23.083368879 +0000 UTC m=+10.045299468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083780 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083803 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083815 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:19.084137 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.083862 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:23.083848166 +0000 UTC m=+10.045778758 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:19.185204 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:19.185167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:19.185376 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.185336 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:19.185433 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.185398 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:23.185379381 +0000 UTC m=+10.147309999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:19.569654 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:19.569577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:19.570109 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.569708 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:19.570109 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:19.569786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:19.570109 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:19.569925 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:20.567542 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:20.567015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:20.567542 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:20.567175 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:21.567330 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:21.567154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:21.567330 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:21.567272 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:21.567840 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:21.567386 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:21.567840 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:21.567486 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:22.567287 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:22.567251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:22.567473 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:22.567396 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:23.117089 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:23.117049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:23.117264 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:23.117127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:23.117264 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117253 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:23.117397 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117316 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:31.117296104 +0000 UTC m=+18.079226705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:23.117477 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117427 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:23.117477 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117451 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:23.117477 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117465 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:23.117644 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.117518 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:31.11749934 +0000 UTC m=+18.079429932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:23.218450 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:23.218410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:23.218628 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.218588 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:23.218693 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.218650 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:31.218631639 +0000 UTC m=+18.180562228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:23.568363 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:23.568277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:23.568782 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.568401 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:23.568782 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:23.568772 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:23.568926 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:23.568852 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:24.567679 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:24.567196 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:24.567679 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:24.567343 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:25.567256 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:25.567218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:25.567727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:25.567218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:25.567727 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:25.567349 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:25.567727 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:25.567465 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:26.567618 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:26.567590 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:26.568034 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:26.567693 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:27.566939 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:27.566911 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:27.567136 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:27.566921 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:27.567136 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:27.567043 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:27.567136 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:27.567104 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:28.567864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:28.567830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:28.568319 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:28.567971 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:29.567160 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:29.567125 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:29.567337 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:29.567125 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:29.567337 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:29.567245 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:29.567337 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:29.567293 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:30.567118 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:30.567086 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:30.567595 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:30.567195 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:31.182067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:31.182027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:31.182106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182189 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182204 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182221 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182233 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:47.182238797 +0000 UTC m=+34.144169403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:31.182272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.182273 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:20:47.182265325 +0000 UTC m=+34.144195912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:31.283368 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:31.283327 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:31.283559 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.283505 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:31.283629 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.283581 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:47.283561283 +0000 UTC m=+34.245491877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:31.567259 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:31.567173 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:31.567658 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.567312 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:31.567658 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:31.567364 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:31.567658 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:31.567488 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:32.567807 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:32.567776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:32.568255 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:32.567928 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:33.568402 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:33.568368 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:33.568837 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:33.568471 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:33.568837 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:33.568474 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:33.568837 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:33.568585 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:34.567349 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:34.567312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:34.567506 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:34.567450 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:35.567225 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.567068 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:35.568025 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.567111 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:35.568025 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:35.567303 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:35.568025 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:35.567361 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:35.679172 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.679091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qr2zg" event={"ID":"2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d","Type":"ContainerStarted","Data":"e9d4f45c6cd4c015b7aa67056ff5a12ec947cb86c0b41266ac82ac5be637c0e1"} Jul 29 10:20:35.680636 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.680610 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="bb4f19d82fb543a8ea938a0fb2e0a5b5ccc8eb020f944ebba2e4591e4ab2adf6" exitCode=0 Jul 29 10:20:35.680757 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.680685 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"bb4f19d82fb543a8ea938a0fb2e0a5b5ccc8eb020f944ebba2e4591e4ab2adf6"} Jul 29 10:20:35.681999 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.681964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rwxhg" event={"ID":"29664a2f-cbb6-421a-abd1-1700a502dcd8","Type":"ContainerStarted","Data":"ad48e216f6c7995707d88ab72110ede6c00b8a69bfe5099899de8b9acdef9b48"} Jul 29 10:20:35.683436 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.683411 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" event={"ID":"e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a","Type":"ContainerStarted","Data":"101145a4c171aa80ef6ff91901da0fd28d7153606f92b8d3d51c953d73ec84d8"} Jul 29 10:20:35.684908 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.684890 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" event={"ID":"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7","Type":"ContainerStarted","Data":"440d8174ff240639e7e4b52766cefc9a55506c4bf489bef9a9883ee14e977503"} Jul 29 10:20:35.686076 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.686055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkppp" event={"ID":"af893ee0-5ee0-4dd8-92de-815dd0a3bd96","Type":"ContainerStarted","Data":"c754b0f9825d821468f9425e952f12ec4b90f1c65ba77a3ac365548690d5abad"} Jul 29 10:20:35.687454 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.687431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qmxrv" event={"ID":"6dabb725-7bca-4cc7-bbb1-255b95c820c9","Type":"ContainerStarted","Data":"7682bad7f92a60fea7cd47917198233ff4f4f6e8344055a724323772a3e58c43"} Jul 29 10:20:35.690143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"24673413ea5b82e97608d39314f092e558990b04fb77348b83b010aa7cfccd79"} Jul 29 10:20:35.690208 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"60a3364f7ef32eaec9a5d2b75e0262511b5f8d0668268a0ed6c75261f37815e7"} Jul 29 10:20:35.690251 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"6c67ad90c02a7c3a057d6d1e51d59f61bfc6616363ea8c5918e48b9de9d76b42"} Jul 29 10:20:35.690251 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690247 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"292e04277fe946ab4d5a287bed46899a7d2b5fe1e2af1d5c60f8aba525ff0219"} Jul 29 10:20:35.690314 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690274 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"2e2a7889e8c9e89e7e3ae4f18382a7af9eaaea649407358494b4da754be81192"} Jul 29 10:20:35.690314 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.690300 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"ce116b5f39a3055d21812b885e4ce8c0ef218f1e381dfb81b26d21f93f37bc11"} Jul 29 10:20:35.699123 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.699084 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-91.ec2.internal" podStartSLOduration=21.699058357 podStartE2EDuration="21.699058357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:18.66752374 +0000 UTC m=+5.629454349" watchObservedRunningTime="2026-07-29 10:20:35.699058357 +0000 UTC m=+22.660988957" Jul 29 10:20:35.699572 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.699550 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qr2zg" podStartSLOduration=4.242201875 podStartE2EDuration="22.699542383s" totalImagesPullingTime="18.457340508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:35.69921581 +0000 UTC m=+22.661146417" watchObservedRunningTime="2026-07-29 10:20:35.699542383 +0000 UTC m=+22.661472990" Jul 29 10:20:35.727351 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.727312 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l2v9k" podStartSLOduration=4.364707351 podStartE2EDuration="22.727300279s" totalImagesPullingTime="18.362592928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:35.727107687 +0000 UTC m=+22.689038294" watchObservedRunningTime="2026-07-29 10:20:35.727300279 +0000 UTC m=+22.689230887" Jul 29 10:20:35.805923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.805857 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rwxhg" podStartSLOduration=4.441752117 podStartE2EDuration="22.805842629s" totalImagesPullingTime="18.364090512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:35.762511891 +0000 UTC m=+22.724442500" watchObservedRunningTime="2026-07-29 10:20:35.805842629 +0000 UTC m=+22.767773398" Jul 29 10:20:35.824068 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.824031 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kkppp" podStartSLOduration=4.454640227 podStartE2EDuration="22.824017542s" totalImagesPullingTime="18.369377315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:35.823794489 +0000 UTC m=+22.785725096" watchObservedRunningTime="2026-07-29 10:20:35.824017542 +0000 UTC m=+22.785948150" Jul 29 10:20:35.841256 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:35.841216 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qmxrv" podStartSLOduration=4.472326256 podStartE2EDuration="22.841201569s" totalImagesPullingTime="18.368875313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:35.841022194 +0000 UTC m=+22.802952813" watchObservedRunningTime="2026-07-29 10:20:35.841201569 +0000 UTC m=+22.803132176" Jul 29 10:20:36.567695 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:36.567620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:36.568255 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:36.567761 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:36.694405 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:36.694371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8tjk2" event={"ID":"6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce","Type":"ContainerStarted","Data":"60e5b320d6c519e28e7fb5ff4ecd4678083bc008bee980268b5329b8bd1fa69b"} Jul 29 10:20:36.711763 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:36.711716 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8tjk2" podStartSLOduration=5.307566836 podStartE2EDuration="23.711700642s" totalImagesPullingTime="18.404133806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:36.71160639 +0000 UTC m=+23.673536997" watchObservedRunningTime="2026-07-29 10:20:36.711700642 +0000 UTC m=+23.673631251" Jul 29 10:20:36.732043 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:36.732013 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 10:20:37.517412 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.517298 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T10:20:36.732034405Z","UUID":"4cca82f1-29b3-4722-86c5-ef267f43792e","Handler":null,"Name":"","Endpoint":""} Jul 29 10:20:37.518959 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.518937 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 10:20:37.519098 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.518970 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 10:20:37.566933 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.566904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:37.567105 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.566916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:37.567105 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:37.567031 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:37.567213 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:37.567111 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:37.698391 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:37.698237 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" event={"ID":"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7","Type":"ContainerStarted","Data":"5ec7d6efd28e1b1a559eeb856ef03e4e49fbbc7ef933d5fffcadbac1bff9d07a"} Jul 29 10:20:38.101720 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.101689 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:38.102274 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.102251 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:38.567279 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.567247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:38.567461 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:38.567372 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:38.704211 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.704180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"b5d4f96c8fb6b2254b0e7c54f162a36f2d4d13bbf5b1be9eb62834fb8ee4fdeb"} Jul 29 10:20:38.706187 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.706161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" event={"ID":"2c49a19e-066f-4f1f-b920-4e5dac9d2ba7","Type":"ContainerStarted","Data":"20aa4bcf334e6321ad5b7f3007afa673286959da16980391bf7b301a419f6cd0"} Jul 29 10:20:38.706380 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.706364 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:38.706975 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.706959 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qmxrv" Jul 29 10:20:38.731200 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:38.731155 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-krxpb" podStartSLOduration=4.6434243649999996 podStartE2EDuration="25.731143134s" totalImagesPullingTime="21.087718769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:38.730967999 +0000 UTC m=+25.692898608" watchObservedRunningTime="2026-07-29 10:20:38.731143134 +0000 UTC m=+25.693073741" Jul 29 10:20:39.567515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:39.567464 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:39.567697 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:39.567598 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:39.567697 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:39.567647 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:39.567821 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:39.567762 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:40.567443 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.567240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:40.567975 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:40.567473 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:40.712618 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.712586 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="5e00aea18cb17a5052c51fd969638b4f5c92a902c050b384983de615b8cab38b" exitCode=0 Jul 29 10:20:40.712811 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.712680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"5e00aea18cb17a5052c51fd969638b4f5c92a902c050b384983de615b8cab38b"} Jul 29 10:20:40.716253 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.716226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" event={"ID":"9e3994ee-1701-458b-b35d-cc15970abb28","Type":"ContainerStarted","Data":"b5984b4b68c787a666736a0f702774fb2f4d0a6cdefd2e217311868887ebfa9e"} Jul 29 10:20:40.716474 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.716462 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:40.716550 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.716513 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:40.716606 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.716553 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:40.731708 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.731684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:40.731843 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.731817 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:20:40.769214 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:40.769174 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" podStartSLOduration=9.332518571 podStartE2EDuration="27.769159158s" totalImagesPullingTime="18.436640587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:40.768196748 +0000 UTC m=+27.730127356" watchObservedRunningTime="2026-07-29 10:20:40.769159158 +0000 UTC m=+27.731089767" Jul 29 10:20:41.567644 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:41.567577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:41.568117 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:41.567577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:41.568117 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:41.567777 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:41.568117 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:41.567942 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:42.101758 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.101592 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxwzp"] Jul 29 10:20:42.101947 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.101858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:42.101998 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:42.101953 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:42.103662 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.103638 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6lcd"] Jul 29 10:20:42.103775 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.103740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:42.103833 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:42.103817 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:42.119141 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.119004 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-895ll"] Jul 29 10:20:42.119141 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.119113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:42.119272 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:42.119193 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:42.722844 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.722812 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="37576a5debddacf826f195746c774a7fa6e3b357ff1c2476382668d9b2c2d99e" exitCode=0 Jul 29 10:20:42.723233 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:42.722914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"37576a5debddacf826f195746c774a7fa6e3b357ff1c2476382668d9b2c2d99e"} Jul 29 10:20:43.568064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:43.568035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:43.568245 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:43.568137 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:43.568245 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:43.568212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:43.568330 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:43.568285 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:43.568330 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:43.568326 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:43.568411 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:43.568395 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:44.729328 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:44.729286 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="b67be3d9326546c454f02c5855258bfb4057c379180ef9f1861f1fe94a02a379" exitCode=0 Jul 29 10:20:44.730012 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:44.729337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"b67be3d9326546c454f02c5855258bfb4057c379180ef9f1861f1fe94a02a379"} Jul 29 10:20:45.567042 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:45.567007 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:45.567230 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:45.567014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:45.567230 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:45.567121 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:45.567230 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:45.567215 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:45.567405 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:45.567019 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:45.567405 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:45.567375 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:47.203741 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.203707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.203764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.203849 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.203910 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.203926 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs podName:e12f1c68-731d-430c-9bf8-d1dd2b2a60d7 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:19.203907627 +0000 UTC m=+66.165838221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs") pod "network-metrics-daemon-895ll" (UID: "e12f1c68-731d-430c-9bf8-d1dd2b2a60d7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.203935 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.203949 2558 projected.go:196] Error preparing data for projected volume kube-api-access-g8c9d for pod openshift-network-diagnostics/network-check-target-kxwzp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:47.204254 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.204003 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d podName:c3b93cfd-370c-4b07-a767-b72be7e3d4ba nodeName:}" failed. No retries permitted until 2026-07-29 10:21:19.203987178 +0000 UTC m=+66.165917781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8c9d" (UniqueName: "kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d") pod "network-check-target-kxwzp" (UID: "c3b93cfd-370c-4b07-a767-b72be7e3d4ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 10:20:47.304640 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.304596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:47.304841 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.304813 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:47.304983 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.304911 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret podName:c6c9065c-0112-490a-876a-2ad60639d743 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:19.304888088 +0000 UTC m=+66.266818691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret") pod "global-pull-secret-syncer-f6lcd" (UID: "c6c9065c-0112-490a-876a-2ad60639d743") : object "kube-system"/"original-pull-secret" not registered Jul 29 10:20:47.567564 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.567485 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:47.567564 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.567529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:47.567812 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.567614 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kxwzp" podUID="c3b93cfd-370c-4b07-a767-b72be7e3d4ba" Jul 29 10:20:47.567812 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.567669 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-895ll" podUID="e12f1c68-731d-430c-9bf8-d1dd2b2a60d7" Jul 29 10:20:47.567812 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.567699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:47.567812 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:47.567800 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f6lcd" podUID="c6c9065c-0112-490a-876a-2ad60639d743" Jul 29 10:20:47.891548 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.891471 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-91.ec2.internal" event="NodeReady" Jul 29 10:20:47.891709 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.891622 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 10:20:47.930773 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.930738 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:20:47.934077 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.933578 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:47.936047 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.936008 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 10:20:47.936169 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.936046 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 10:20:47.936169 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.936143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 10:20:47.936489 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.936472 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6r4qm\"" Jul 29 10:20:47.941155 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.941117 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cnp2s"] Jul 29 10:20:47.943079 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.942720 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 10:20:47.943736 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.943318 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:47.944584 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.944562 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-smr9q"] Jul 29 10:20:47.945976 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.945951 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 10:20:47.946330 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.946161 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9v9pt\"" Jul 29 10:20:47.946330 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.946204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 10:20:47.946609 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.946591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:47.947518 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.947500 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:20:47.949397 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.949370 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 10:20:47.949494 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.949424 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 10:20:47.949494 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.949435 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gmp8s\"" Jul 29 10:20:47.949694 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.949675 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 10:20:47.956761 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.956728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cnp2s"] Jul 29 10:20:47.960737 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:47.960516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smr9q"] Jul 29 10:20:48.009662 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.009662 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.009923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.009923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.009923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.009923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.010187 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.009976 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.010187 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.010008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t94k\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.110822 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.110788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.110822 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.110826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111070 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.110849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adda7f6f-91bf-4275-b61c-2a562c553e7b-cert\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.111070 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111175 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.111175 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111175 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/649878a0-5049-4eaf-8317-2eec67e6dd2a-config-volume\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.111301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111196 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92ln2\" (UniqueName: \"kubernetes.io/projected/649878a0-5049-4eaf-8317-2eec67e6dd2a-kube-api-access-92ln2\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.111301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t94k\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/649878a0-5049-4eaf-8317-2eec67e6dd2a-tmp-dir\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.111429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111560 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111438 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7nl8\" (UniqueName: \"kubernetes.io/projected/adda7f6f-91bf-4275-b61c-2a562c553e7b-kube-api-access-c7nl8\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.111617 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.111584 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:20:48.111617 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.111599 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b86d986cf-jbzqv: secret "image-registry-tls" not found Jul 29 10:20:48.111711 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111678 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.111711 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.111683 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls podName:c22b8005-757c-4f0d-9920-ed161ab0cce0 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:48.61166028 +0000 UTC m=+35.573590897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls") pod "image-registry-b86d986cf-jbzqv" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0") : secret "image-registry-tls" not found Jul 29 10:20:48.111959 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.111936 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.112357 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.112330 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.115764 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.115712 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.116238 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.116205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.125958 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.125930 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t94k\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.126174 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.126155 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.212470 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7nl8\" (UniqueName: \"kubernetes.io/projected/adda7f6f-91bf-4275-b61c-2a562c553e7b-kube-api-access-c7nl8\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.212470 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adda7f6f-91bf-4275-b61c-2a562c553e7b-cert\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.212470 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/649878a0-5049-4eaf-8317-2eec67e6dd2a-config-volume\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92ln2\" (UniqueName: \"kubernetes.io/projected/649878a0-5049-4eaf-8317-2eec67e6dd2a-kube-api-access-92ln2\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.212620 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/649878a0-5049-4eaf-8317-2eec67e6dd2a-tmp-dir\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.212687 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls podName:649878a0-5049-4eaf-8317-2eec67e6dd2a nodeName:}" failed. No retries permitted until 2026-07-29 10:20:48.712666763 +0000 UTC m=+35.674597368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls") pod "dns-default-cnp2s" (UID: "649878a0-5049-4eaf-8317-2eec67e6dd2a") : secret "dns-default-metrics-tls" not found Jul 29 10:20:48.213102 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.212996 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/649878a0-5049-4eaf-8317-2eec67e6dd2a-tmp-dir\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.213371 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.213142 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/649878a0-5049-4eaf-8317-2eec67e6dd2a-config-volume\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.215140 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.215117 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adda7f6f-91bf-4275-b61c-2a562c553e7b-cert\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.226308 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.226284 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92ln2\" (UniqueName: \"kubernetes.io/projected/649878a0-5049-4eaf-8317-2eec67e6dd2a-kube-api-access-92ln2\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.226501 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.226483 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7nl8\" (UniqueName: \"kubernetes.io/projected/adda7f6f-91bf-4275-b61c-2a562c553e7b-kube-api-access-c7nl8\") pod \"ingress-canary-smr9q\" (UID: \"adda7f6f-91bf-4275-b61c-2a562c553e7b\") " pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.263614 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.263584 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smr9q" Jul 29 10:20:48.564279 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.564197 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4pfwd"] Jul 29 10:20:48.566184 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.566164 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.568814 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.568797 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 10:20:48.568948 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.568795 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 10:20:48.569008 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.568963 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqhdx\"" Jul 29 10:20:48.569256 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.569233 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 10:20:48.569506 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.569489 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 10:20:48.579865 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.579840 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4pfwd"] Jul 29 10:20:48.615868 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.615840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:48.616021 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.616002 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:20:48.616096 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.616023 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b86d986cf-jbzqv: secret "image-registry-tls" not found Jul 29 10:20:48.616096 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.616077 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls podName:c22b8005-757c-4f0d-9920-ed161ab0cce0 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:49.616059019 +0000 UTC m=+36.577989610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls") pod "image-registry-b86d986cf-jbzqv" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0") : secret "image-registry-tls" not found Jul 29 10:20:48.716423 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:48.716423 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.716651 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5c4008b-27e2-452f-a05f-244681f5733d-crio-socket\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.716651 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5c4008b-27e2-452f-a05f-244681f5733d-data-volume\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.716651 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9pkh\" (UniqueName: \"kubernetes.io/projected/a5c4008b-27e2-452f-a05f-244681f5733d-kube-api-access-w9pkh\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.716651 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.716579 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:20:48.716816 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.716684 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls podName:649878a0-5049-4eaf-8317-2eec67e6dd2a nodeName:}" failed. No retries permitted until 2026-07-29 10:20:49.716663933 +0000 UTC m=+36.678594520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls") pod "dns-default-cnp2s" (UID: "649878a0-5049-4eaf-8317-2eec67e6dd2a") : secret "dns-default-metrics-tls" not found Jul 29 10:20:48.716816 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.716775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817668 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817668 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817668 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.817550 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:20:48.817829 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5c4008b-27e2-452f-a05f-244681f5733d-crio-socket\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817829 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5c4008b-27e2-452f-a05f-244681f5733d-data-volume\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817829 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.817756 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:20:48.817829 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9pkh\" (UniqueName: \"kubernetes.io/projected/a5c4008b-27e2-452f-a05f-244681f5733d-kube-api-access-w9pkh\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.817829 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.817785 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:49.317747672 +0000 UTC m=+36.279678267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : configmap "kube-rbac-proxy" not found Jul 29 10:20:48.818071 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:48.817840 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:49.317814154 +0000 UTC m=+36.279744755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:20:48.818071 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.817854 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5c4008b-27e2-452f-a05f-244681f5733d-crio-socket\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.818148 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.818078 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5c4008b-27e2-452f-a05f-244681f5733d-data-volume\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.835067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.835023 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9pkh\" (UniqueName: \"kubernetes.io/projected/a5c4008b-27e2-452f-a05f-244681f5733d-kube-api-access-w9pkh\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:48.941485 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:48.941455 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smr9q"] Jul 29 10:20:48.945091 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:48.945066 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadda7f6f_91bf_4275_b61c_2a562c553e7b.slice/crio-36cd7ae6c407f2c9a4ca8bfce4f7dc54761883ce6fd1f37a62847b49c3a90b09 WatchSource:0}: Error finding container 36cd7ae6c407f2c9a4ca8bfce4f7dc54761883ce6fd1f37a62847b49c3a90b09: Status 404 returned error can't find the container with id 36cd7ae6c407f2c9a4ca8bfce4f7dc54761883ce6fd1f37a62847b49c3a90b09 Jul 29 10:20:49.322015 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.321986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:49.322370 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.322030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:49.322370 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.322116 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:20:49.322370 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.322153 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:20:49.322370 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.322186 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:50.322169438 +0000 UTC m=+37.284100026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : configmap "kube-rbac-proxy" not found Jul 29 10:20:49.322370 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.322201 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:50.322195221 +0000 UTC m=+37.284125807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:20:49.566912 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.566863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:20:49.567070 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.566863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:20:49.567070 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.567014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:20:49.572797 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.572724 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:20:49.572797 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.572769 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:20:49.573005 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.572724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq88l\"" Jul 29 10:20:49.573066 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.573039 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:20:49.573947 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.573927 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbvt\"" Jul 29 10:20:49.574069 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.573933 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:20:49.624107 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.624082 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:49.624257 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.624236 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:20:49.624257 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.624255 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b86d986cf-jbzqv: secret "image-registry-tls" not found Jul 29 10:20:49.624413 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.624304 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls podName:c22b8005-757c-4f0d-9920-ed161ab0cce0 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:51.624290247 +0000 UTC m=+38.586220857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls") pod "image-registry-b86d986cf-jbzqv" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0") : secret "image-registry-tls" not found Jul 29 10:20:49.725191 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.725157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:49.725373 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.725330 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:20:49.725432 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:49.725408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls podName:649878a0-5049-4eaf-8317-2eec67e6dd2a nodeName:}" failed. No retries permitted until 2026-07-29 10:20:51.725387289 +0000 UTC m=+38.687317877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls") pod "dns-default-cnp2s" (UID: "649878a0-5049-4eaf-8317-2eec67e6dd2a") : secret "dns-default-metrics-tls" not found Jul 29 10:20:49.744830 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.744801 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="b872c750acaebdca6b4f466d483e6cc678533451151dbe110bd4638eb52f7290" exitCode=0 Jul 29 10:20:49.744984 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.744898 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"b872c750acaebdca6b4f466d483e6cc678533451151dbe110bd4638eb52f7290"} Jul 29 10:20:49.746087 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:49.746066 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smr9q" event={"ID":"adda7f6f-91bf-4275-b61c-2a562c553e7b","Type":"ContainerStarted","Data":"36cd7ae6c407f2c9a4ca8bfce4f7dc54761883ce6fd1f37a62847b49c3a90b09"} Jul 29 10:20:50.331733 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:50.331536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:50.332166 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:50.331779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:50.332166 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:50.331676 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:20:50.332166 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:50.331903 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:52.331865469 +0000 UTC m=+39.293796076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : configmap "kube-rbac-proxy" not found Jul 29 10:20:50.332166 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:50.331966 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:20:50.332166 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:50.332027 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:52.332014124 +0000 UTC m=+39.293944709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:20:50.540072 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:50.540038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkppp_af893ee0-5ee0-4dd8-92de-815dd0a3bd96/dns-node-resolver/0.log" Jul 29 10:20:50.752046 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:50.751959 2558 generic.go:356] "Generic (PLEG): container finished" podID="bf84ffdf-c678-453a-a765-8f167b90ce68" containerID="b8eb43985367185f41903700b43f1179bc82c4bc65345b279dc638c6ba8e1e33" exitCode=0 Jul 29 10:20:50.752194 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:50.752042 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerDied","Data":"b8eb43985367185f41903700b43f1179bc82c4bc65345b279dc638c6ba8e1e33"} Jul 29 10:20:51.643067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.643029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:51.643520 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:51.643182 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:20:51.643520 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:51.643201 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b86d986cf-jbzqv: secret "image-registry-tls" not found Jul 29 10:20:51.643520 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:51.643254 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls podName:c22b8005-757c-4f0d-9920-ed161ab0cce0 nodeName:}" failed. No retries permitted until 2026-07-29 10:20:55.643239283 +0000 UTC m=+42.605169869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls") pod "image-registry-b86d986cf-jbzqv" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0") : secret "image-registry-tls" not found Jul 29 10:20:51.741234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.741205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rwxhg_29664a2f-cbb6-421a-abd1-1700a502dcd8/node-ca/0.log" Jul 29 10:20:51.743414 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.743395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:51.743586 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:51.743569 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:20:51.743647 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:51.743638 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls podName:649878a0-5049-4eaf-8317-2eec67e6dd2a nodeName:}" failed. No retries permitted until 2026-07-29 10:20:55.743620004 +0000 UTC m=+42.705550592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls") pod "dns-default-cnp2s" (UID: "649878a0-5049-4eaf-8317-2eec67e6dd2a") : secret "dns-default-metrics-tls" not found Jul 29 10:20:51.758086 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.758053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" event={"ID":"bf84ffdf-c678-453a-a765-8f167b90ce68","Type":"ContainerStarted","Data":"6cd95e8cd35dc1e31c811c46559e38cad0832477474eec30c1253693dc3fa3ad"} Jul 29 10:20:51.759588 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.759565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smr9q" event={"ID":"adda7f6f-91bf-4275-b61c-2a562c553e7b","Type":"ContainerStarted","Data":"3489e2c8607b07335677af103d3669a3a8ee759a54e0bfa703e56b235d63d8be"} Jul 29 10:20:51.786420 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.786305 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mw2j8" podStartSLOduration=9.436988562 podStartE2EDuration="38.786292162s" totalImagesPullingTime="29.3493036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:51.785101644 +0000 UTC m=+38.747032274" watchObservedRunningTime="2026-07-29 10:20:51.786292162 +0000 UTC m=+38.748222770" Jul 29 10:20:51.805055 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.805001 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-smr9q" podStartSLOduration=2.204743218 podStartE2EDuration="4.804980284s" totalImagesPullingTime="2.600237066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:51.803649039 +0000 UTC m=+38.765579647" watchObservedRunningTime="2026-07-29 10:20:51.804980284 +0000 UTC m=+38.766910893" Jul 29 10:20:51.852958 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.852932 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-frnjd"] Jul 29 10:20:51.859590 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.859567 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:51.862236 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.862211 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 10:20:51.862515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.862495 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 10:20:51.862621 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.862505 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 10:20:51.862621 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.862588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rcq8k\"" Jul 29 10:20:51.862857 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.862843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 10:20:51.866717 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.866697 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-frnjd"] Jul 29 10:20:51.946314 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.946276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qccx\" (UniqueName: \"kubernetes.io/projected/2be70339-f1c0-440d-9cd9-a0ce0d84a480-kube-api-access-8qccx\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:51.946457 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.946387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-key\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:51.946493 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:51.946451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-cabundle\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.046974 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.046862 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-key\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.046974 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.046927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-cabundle\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.047141 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.047006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qccx\" (UniqueName: \"kubernetes.io/projected/2be70339-f1c0-440d-9cd9-a0ce0d84a480-kube-api-access-8qccx\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.047670 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.047650 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-cabundle\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.050530 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.050510 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2be70339-f1c0-440d-9cd9-a0ce0d84a480-signing-key\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.056420 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.056397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qccx\" (UniqueName: \"kubernetes.io/projected/2be70339-f1c0-440d-9cd9-a0ce0d84a480-kube-api-access-8qccx\") pod \"service-ca-658d7b7c78-frnjd\" (UID: \"2be70339-f1c0-440d-9cd9-a0ce0d84a480\") " pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.168968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.168927 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" Jul 29 10:20:52.310844 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.310769 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-frnjd"] Jul 29 10:20:52.315457 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:20:52.315432 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be70339_f1c0_440d_9cd9_a0ce0d84a480.slice/crio-8802b17acd78d1149bf740736544969025e9668e848d5aa08ea89f0b01c8e9cc WatchSource:0}: Error finding container 8802b17acd78d1149bf740736544969025e9668e848d5aa08ea89f0b01c8e9cc: Status 404 returned error can't find the container with id 8802b17acd78d1149bf740736544969025e9668e848d5aa08ea89f0b01c8e9cc Jul 29 10:20:52.340682 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.340656 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smr9q_adda7f6f-91bf-4275-b61c-2a562c553e7b/serve-healthcheck-canary/0.log" Jul 29 10:20:52.349845 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.349825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:52.349930 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.349865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:52.349973 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:52.349955 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:20:52.350004 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:52.349988 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:20:52.350033 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:52.350017 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:56.350000899 +0000 UTC m=+43.311931485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : configmap "kube-rbac-proxy" not found Jul 29 10:20:52.350033 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:52.350032 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:20:56.350025855 +0000 UTC m=+43.311956442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:20:52.762668 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:52.762584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" event={"ID":"2be70339-f1c0-440d-9cd9-a0ce0d84a480","Type":"ContainerStarted","Data":"8802b17acd78d1149bf740736544969025e9668e848d5aa08ea89f0b01c8e9cc"} Jul 29 10:20:55.676597 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:55.676557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:20:55.677092 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:55.676742 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 10:20:55.677092 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:55.676766 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b86d986cf-jbzqv: secret "image-registry-tls" not found Jul 29 10:20:55.677092 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:55.676831 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls podName:c22b8005-757c-4f0d-9920-ed161ab0cce0 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:03.676810751 +0000 UTC m=+50.638741343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls") pod "image-registry-b86d986cf-jbzqv" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0") : secret "image-registry-tls" not found Jul 29 10:20:55.773011 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:55.772973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" event={"ID":"2be70339-f1c0-440d-9cd9-a0ce0d84a480","Type":"ContainerStarted","Data":"13a11ffd144e2c7f10fb4ec9baf6fff6f2ae8236904085651bb0321bdc130a31"} Jul 29 10:20:55.777980 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:55.777901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:20:55.778127 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:55.778095 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 10:20:55.778192 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:55.778169 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls podName:649878a0-5049-4eaf-8317-2eec67e6dd2a nodeName:}" failed. No retries permitted until 2026-07-29 10:21:03.778151665 +0000 UTC m=+50.740082255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls") pod "dns-default-cnp2s" (UID: "649878a0-5049-4eaf-8317-2eec67e6dd2a") : secret "dns-default-metrics-tls" not found Jul 29 10:20:55.792320 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:55.791231 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-frnjd" podStartSLOduration=2.321293962 podStartE2EDuration="4.791208581s" totalImagesPullingTime="2.469914619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:20:55.790724862 +0000 UTC m=+42.752655476" watchObservedRunningTime="2026-07-29 10:20:55.791208581 +0000 UTC m=+42.753139189" Jul 29 10:20:56.383704 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:56.383667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:56.383928 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:20:56.383717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:20:56.383928 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:56.383809 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 10:20:56.383928 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:56.383819 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:20:56.384099 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:56.383908 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:21:04.383868219 +0000 UTC m=+51.345798818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : configmap "kube-rbac-proxy" not found Jul 29 10:20:56.384099 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:20:56.383954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:21:04.383942769 +0000 UTC m=+51.345873355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:21:03.740671 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.740635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:03.743019 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.742992 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"image-registry-b86d986cf-jbzqv\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:03.841225 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.841192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:21:03.843498 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.843470 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/649878a0-5049-4eaf-8317-2eec67e6dd2a-metrics-tls\") pod \"dns-default-cnp2s\" (UID: \"649878a0-5049-4eaf-8317-2eec67e6dd2a\") " pod="openshift-dns/dns-default-cnp2s" Jul 29 10:21:03.846368 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.846342 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:03.856494 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:03.856473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cnp2s" Jul 29 10:21:04.004628 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.004562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cnp2s"] Jul 29 10:21:04.007789 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.007765 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:21:04.011543 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:04.011523 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22b8005_757c_4f0d_9920_ed161ab0cce0.slice/crio-725b22f8d229b47ee0e243fdff0443d0fe29727c4951c2815a7977efd473b285 WatchSource:0}: Error finding container 725b22f8d229b47ee0e243fdff0443d0fe29727c4951c2815a7977efd473b285: Status 404 returned error can't find the container with id 725b22f8d229b47ee0e243fdff0443d0fe29727c4951c2815a7977efd473b285 Jul 29 10:21:04.447131 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.447098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:04.447294 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.447198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:04.447294 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:04.447254 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 10:21:04.447378 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:04.447324 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls podName:a5c4008b-27e2-452f-a05f-244681f5733d nodeName:}" failed. No retries permitted until 2026-07-29 10:21:20.447308712 +0000 UTC m=+67.409239301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4pfwd" (UID: "a5c4008b-27e2-452f-a05f-244681f5733d") : secret "insights-runtime-extractor-tls" not found Jul 29 10:21:04.447625 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.447609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5c4008b-27e2-452f-a05f-244681f5733d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:04.797000 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.796909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cnp2s" event={"ID":"649878a0-5049-4eaf-8317-2eec67e6dd2a","Type":"ContainerStarted","Data":"830aa6a0b6553c959aaf1bd3db5db6ffb5be5d4d402338e5732fe1932a3f7926"} Jul 29 10:21:04.798604 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.798572 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" event={"ID":"c22b8005-757c-4f0d-9920-ed161ab0cce0","Type":"ContainerStarted","Data":"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7"} Jul 29 10:21:04.798742 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.798620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" event={"ID":"c22b8005-757c-4f0d-9920-ed161ab0cce0","Type":"ContainerStarted","Data":"725b22f8d229b47ee0e243fdff0443d0fe29727c4951c2815a7977efd473b285"} Jul 29 10:21:04.798810 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.798741 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:04.834109 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:04.834063 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" podStartSLOduration=38.834037841 podStartE2EDuration="38.834037841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:04.83389177 +0000 UTC m=+51.795822375" watchObservedRunningTime="2026-07-29 10:21:04.834037841 +0000 UTC m=+51.795968448" Jul 29 10:21:06.804895 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:06.804848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cnp2s" event={"ID":"649878a0-5049-4eaf-8317-2eec67e6dd2a","Type":"ContainerStarted","Data":"5aca01b637dfeb44e2989d80c077053032156c835327f828118ca8bc95175946"} Jul 29 10:21:06.805320 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:06.804913 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cnp2s" event={"ID":"649878a0-5049-4eaf-8317-2eec67e6dd2a","Type":"ContainerStarted","Data":"6a778f364b1da65874e56de36e718756717e2ac6958a77bb11fc88c0c9134064"} Jul 29 10:21:06.805320 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:06.804993 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cnp2s" Jul 29 10:21:06.824019 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:06.823973 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cnp2s" podStartSLOduration=17.522188868 podStartE2EDuration="19.823958568s" totalImagesPullingTime="2.3017697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:06.822996912 +0000 UTC m=+53.784927519" watchObservedRunningTime="2026-07-29 10:21:06.823958568 +0000 UTC m=+53.785889177" Jul 29 10:21:12.736192 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:12.736165 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flwzb" Jul 29 10:21:13.040383 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.040295 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:21:13.130363 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.130333 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-prdfr"] Jul 29 10:21:13.162564 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.162533 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-prdfr"] Jul 29 10:21:13.162708 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.162619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:13.171232 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.170945 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kf2rq\"" Jul 29 10:21:13.173771 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.171610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 10:21:13.173771 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.171853 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 10:21:13.213952 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.213932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k2vh\" (UniqueName: \"kubernetes.io/projected/6a919ea5-d219-45ac-80ca-268ab3c4e8de-kube-api-access-8k2vh\") pod \"downloads-7c97dc4555-prdfr\" (UID: \"6a919ea5-d219-45ac-80ca-268ab3c4e8de\") " pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:13.315156 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.315075 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k2vh\" (UniqueName: \"kubernetes.io/projected/6a919ea5-d219-45ac-80ca-268ab3c4e8de-kube-api-access-8k2vh\") pod \"downloads-7c97dc4555-prdfr\" (UID: \"6a919ea5-d219-45ac-80ca-268ab3c4e8de\") " pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:13.326222 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.326190 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k2vh\" (UniqueName: \"kubernetes.io/projected/6a919ea5-d219-45ac-80ca-268ab3c4e8de-kube-api-access-8k2vh\") pod \"downloads-7c97dc4555-prdfr\" (UID: \"6a919ea5-d219-45ac-80ca-268ab3c4e8de\") " pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:13.472935 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.472905 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kf2rq\"" Jul 29 10:21:13.481133 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.481113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:13.632735 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.632707 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-prdfr"] Jul 29 10:21:13.635812 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:13.635787 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a919ea5_d219_45ac_80ca_268ab3c4e8de.slice/crio-9a3debb914478fdbac4c970633ac4aac4e261357bcb49798f3f596104859b89d WatchSource:0}: Error finding container 9a3debb914478fdbac4c970633ac4aac4e261357bcb49798f3f596104859b89d: Status 404 returned error can't find the container with id 9a3debb914478fdbac4c970633ac4aac4e261357bcb49798f3f596104859b89d Jul 29 10:21:13.821999 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:13.821967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-prdfr" event={"ID":"6a919ea5-d219-45ac-80ca-268ab3c4e8de","Type":"ContainerStarted","Data":"9a3debb914478fdbac4c970633ac4aac4e261357bcb49798f3f596104859b89d"} Jul 29 10:21:16.643096 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.643056 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-d6l6t"] Jul 29 10:21:16.645202 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.645180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.648063 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.648027 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 10:21:16.648533 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.648481 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 10:21:16.649130 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.649108 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 10:21:16.649247 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.649146 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 10:21:16.649835 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.649517 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 10:21:16.649835 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.649556 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m4bm5\"" Jul 29 10:21:16.657683 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.657658 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-d6l6t"] Jul 29 10:21:16.741110 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.741078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2nzb\" (UniqueName: \"kubernetes.io/projected/26561384-e4e9-4bb1-b6fc-a64158d4958c-kube-api-access-p2nzb\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.741295 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.741144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26561384-e4e9-4bb1-b6fc-a64158d4958c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.741295 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.741180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.741295 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.741209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.809170 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.809140 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cnp2s" Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.842498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.842605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2nzb\" (UniqueName: \"kubernetes.io/projected/26561384-e4e9-4bb1-b6fc-a64158d4958c-kube-api-access-p2nzb\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:16.842614 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.842660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26561384-e4e9-4bb1-b6fc-a64158d4958c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.842707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.843149 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:16.843091 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls podName:26561384-e4e9-4bb1-b6fc-a64158d4958c nodeName:}" failed. No retries permitted until 2026-07-29 10:21:17.343067606 +0000 UTC m=+64.304998192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-d6l6t" (UID: "26561384-e4e9-4bb1-b6fc-a64158d4958c") : secret "prometheus-operator-tls" not found Jul 29 10:21:16.843590 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.843447 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26561384-e4e9-4bb1-b6fc-a64158d4958c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.845803 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.845759 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:16.853987 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:16.853960 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2nzb\" (UniqueName: \"kubernetes.io/projected/26561384-e4e9-4bb1-b6fc-a64158d4958c-kube-api-access-p2nzb\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:17.346631 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:17.346596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:17.349251 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:17.349224 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26561384-e4e9-4bb1-b6fc-a64158d4958c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-d6l6t\" (UID: \"26561384-e4e9-4bb1-b6fc-a64158d4958c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:17.559666 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:17.559633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" Jul 29 10:21:17.713979 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:17.713790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-d6l6t"] Jul 29 10:21:17.716597 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:17.716570 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26561384_e4e9_4bb1_b6fc_a64158d4958c.slice/crio-2240247d6da637bcad1db0812dd2d84286f2e5649fab34cd7e1f62631279df7f WatchSource:0}: Error finding container 2240247d6da637bcad1db0812dd2d84286f2e5649fab34cd7e1f62631279df7f: Status 404 returned error can't find the container with id 2240247d6da637bcad1db0812dd2d84286f2e5649fab34cd7e1f62631279df7f Jul 29 10:21:17.834334 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:17.834297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" event={"ID":"26561384-e4e9-4bb1-b6fc-a64158d4958c","Type":"ContainerStarted","Data":"2240247d6da637bcad1db0812dd2d84286f2e5649fab34cd7e1f62631279df7f"} Jul 29 10:21:19.263145 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.263104 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:21:19.263587 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.263189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:21:19.265783 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.265762 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 10:21:19.266654 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.266634 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 10:21:19.276270 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.276242 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 10:21:19.277290 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.276724 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e12f1c68-731d-430c-9bf8-d1dd2b2a60d7-metrics-certs\") pod \"network-metrics-daemon-895ll\" (UID: \"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7\") " pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:21:19.287574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.287548 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8c9d\" (UniqueName: \"kubernetes.io/projected/c3b93cfd-370c-4b07-a767-b72be7e3d4ba-kube-api-access-g8c9d\") pod \"network-check-target-kxwzp\" (UID: \"c3b93cfd-370c-4b07-a767-b72be7e3d4ba\") " pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:21:19.294835 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.294776 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbvt\"" Jul 29 10:21:19.302905 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.302864 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-895ll" Jul 29 10:21:19.364842 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.364582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:21:19.367913 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.367764 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 10:21:19.377678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.377652 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c6c9065c-0112-490a-876a-2ad60639d743-original-pull-secret\") pod \"global-pull-secret-syncer-f6lcd\" (UID: \"c6c9065c-0112-490a-876a-2ad60639d743\") " pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:21:19.461616 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.461585 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-895ll"] Jul 29 10:21:19.466471 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:19.466449 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12f1c68_731d_430c_9bf8_d1dd2b2a60d7.slice/crio-d0b6283eebb304766f84b03faa2fac6f0c6489cf7b0772e3b18a2445b64089d1 WatchSource:0}: Error finding container d0b6283eebb304766f84b03faa2fac6f0c6489cf7b0772e3b18a2445b64089d1: Status 404 returned error can't find the container with id d0b6283eebb304766f84b03faa2fac6f0c6489cf7b0772e3b18a2445b64089d1 Jul 29 10:21:19.583545 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.583517 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gq88l\"" Jul 29 10:21:19.586885 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.586854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f6lcd" Jul 29 10:21:19.590647 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.590625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:21:19.744048 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.744018 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kxwzp"] Jul 29 10:21:19.747159 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:19.747133 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b93cfd_370c_4b07_a767_b72be7e3d4ba.slice/crio-7a949e1248ff1ecc585568b933e65538578118bddcf8cc31e4cfdcc514c78d3c WatchSource:0}: Error finding container 7a949e1248ff1ecc585568b933e65538578118bddcf8cc31e4cfdcc514c78d3c: Status 404 returned error can't find the container with id 7a949e1248ff1ecc585568b933e65538578118bddcf8cc31e4cfdcc514c78d3c Jul 29 10:21:19.754149 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.754126 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f6lcd"] Jul 29 10:21:19.756806 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:19.756779 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c9065c_0112_490a_876a_2ad60639d743.slice/crio-e9545eb5416f094953822ad59c40779c23ebca94a3cdd38791e99cc865364e58 WatchSource:0}: Error finding container e9545eb5416f094953822ad59c40779c23ebca94a3cdd38791e99cc865364e58: Status 404 returned error can't find the container with id e9545eb5416f094953822ad59c40779c23ebca94a3cdd38791e99cc865364e58 Jul 29 10:21:19.843424 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.843341 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" event={"ID":"26561384-e4e9-4bb1-b6fc-a64158d4958c","Type":"ContainerStarted","Data":"43be3c6b7507ec9d84d65494509b44b7d0b6ba3b799bbd3d6cb765d9599de7c5"} Jul 29 10:21:19.843424 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.843400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" event={"ID":"26561384-e4e9-4bb1-b6fc-a64158d4958c","Type":"ContainerStarted","Data":"bebaec68d597cc5cc2c102e0fa8e1193d80b34c8c3a51fb238b8cf6e256cb827"} Jul 29 10:21:19.844675 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.844643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6lcd" event={"ID":"c6c9065c-0112-490a-876a-2ad60639d743","Type":"ContainerStarted","Data":"e9545eb5416f094953822ad59c40779c23ebca94a3cdd38791e99cc865364e58"} Jul 29 10:21:19.845936 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.845910 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-895ll" event={"ID":"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7","Type":"ContainerStarted","Data":"d0b6283eebb304766f84b03faa2fac6f0c6489cf7b0772e3b18a2445b64089d1"} Jul 29 10:21:19.847255 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.847227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxwzp" event={"ID":"c3b93cfd-370c-4b07-a767-b72be7e3d4ba","Type":"ContainerStarted","Data":"7a949e1248ff1ecc585568b933e65538578118bddcf8cc31e4cfdcc514c78d3c"} Jul 29 10:21:19.863786 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:19.863746 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-d6l6t" podStartSLOduration=2.540976852 podStartE2EDuration="3.863724235s" totalImagesPullingTime="1.322747383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:19.863395659 +0000 UTC m=+66.825326259" watchObservedRunningTime="2026-07-29 10:21:19.863724235 +0000 UTC m=+66.825654844" Jul 29 10:21:20.473267 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:20.473218 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:20.481444 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:20.481416 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5c4008b-27e2-452f-a05f-244681f5733d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4pfwd\" (UID: \"a5c4008b-27e2-452f-a05f-244681f5733d\") " pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:20.682374 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:20.682134 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fqhdx\"" Jul 29 10:21:20.690364 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:20.690337 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4pfwd" Jul 29 10:21:20.871575 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:20.870470 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4pfwd"] Jul 29 10:21:20.938713 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:20.938670 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c4008b_27e2_452f_a05f_244681f5733d.slice/crio-f10484cc5290e505e78f9ee24465b421990f66000932354702ecb04c5de8eaf9 WatchSource:0}: Error finding container f10484cc5290e505e78f9ee24465b421990f66000932354702ecb04c5de8eaf9: Status 404 returned error can't find the container with id f10484cc5290e505e78f9ee24465b421990f66000932354702ecb04c5de8eaf9 Jul 29 10:21:21.866432 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:21.866392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4pfwd" event={"ID":"a5c4008b-27e2-452f-a05f-244681f5733d","Type":"ContainerStarted","Data":"f10484cc5290e505e78f9ee24465b421990f66000932354702ecb04c5de8eaf9"} Jul 29 10:21:21.870931 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:21.870901 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-895ll" event={"ID":"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7","Type":"ContainerStarted","Data":"03471a27bba2b4bdd88eb4d57198b45347b49c4693a6da72e81c770dcc3496e2"} Jul 29 10:21:21.871085 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:21.870960 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-895ll" event={"ID":"e12f1c68-731d-430c-9bf8-d1dd2b2a60d7","Type":"ContainerStarted","Data":"61a8b4158579d1cbda9eba9936d308483c80d58531065e5753159dc242fb6767"} Jul 29 10:21:22.042548 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.042484 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-895ll" podStartSLOduration=67.54229327 podStartE2EDuration="1m9.042460569s" totalImagesPullingTime="1.500167299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:21.895132574 +0000 UTC m=+68.857063183" watchObservedRunningTime="2026-07-29 10:21:22.042460569 +0000 UTC m=+69.004391179" Jul 29 10:21:22.043573 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.043549 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9"] Jul 29 10:21:22.080990 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.079973 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9"] Jul 29 10:21:22.080990 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.080023 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c65sq"] Jul 29 10:21:22.081193 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.081158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.086400 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.084368 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 10:21:22.086400 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.084582 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rsc9m\"" Jul 29 10:21:22.086400 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.084759 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 10:21:22.098097 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.096549 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.100991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.100016 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 10:21:22.100991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.100251 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wtdv9\"" Jul 29 10:21:22.100991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.100555 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 10:21:22.100991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.100752 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 10:21:22.189252 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189159 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.189252 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-root\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189252 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-wtmp\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tjj\" (UniqueName: \"kubernetes.io/projected/107d8279-51e7-450b-a3bf-fa2e840e8bfe-kube-api-access-l6tjj\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msdxj\" (UniqueName: \"kubernetes.io/projected/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-kube-api-access-msdxj\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/107d8279-51e7-450b-a3bf-fa2e840e8bfe-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-sys\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-metrics-client-ca\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.189515 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-tls\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189930 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.189930 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.189559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-textfile\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-textfile\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-root\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-wtmp\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290171 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tjj\" (UniqueName: \"kubernetes.io/projected/107d8279-51e7-450b-a3bf-fa2e840e8bfe-kube-api-access-l6tjj\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msdxj\" (UniqueName: \"kubernetes.io/projected/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-kube-api-access-msdxj\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/107d8279-51e7-450b-a3bf-fa2e840e8bfe-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-sys\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-metrics-client-ca\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.290832 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.290380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-tls\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.291634 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.291209 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-root\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.291634 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.291283 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-textfile\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.291634 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:22.291314 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 10:21:22.291634 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:22.291402 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls podName:107d8279-51e7-450b-a3bf-fa2e840e8bfe nodeName:}" failed. No retries permitted until 2026-07-29 10:21:22.791380444 +0000 UTC m=+69.753311033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-gxmx9" (UID: "107d8279-51e7-450b-a3bf-fa2e840e8bfe") : secret "openshift-state-metrics-tls" not found Jul 29 10:21:22.291634 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.291406 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-wtmp\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.291942 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.291766 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-sys\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.292341 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-metrics-client-ca\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.295363 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-tls\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.295662 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.302452 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.307707 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.308968 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.308901 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/107d8279-51e7-450b-a3bf-fa2e840e8bfe-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.312628 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.312571 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tjj\" (UniqueName: \"kubernetes.io/projected/107d8279-51e7-450b-a3bf-fa2e840e8bfe-kube-api-access-l6tjj\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.313960 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.313855 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msdxj\" (UniqueName: \"kubernetes.io/projected/5ee808d2-e7bd-4191-bb51-7411f7fcb2dc-kube-api-access-msdxj\") pod \"node-exporter-c65sq\" (UID: \"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc\") " pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.414606 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.414357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c65sq" Jul 29 10:21:22.462534 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:22.462501 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee808d2_e7bd_4191_bb51_7411f7fcb2dc.slice/crio-4b267df315f55d2747ca4a1ba3cf99bae078ae91ff3a08db87a1ca632223f5e2 WatchSource:0}: Error finding container 4b267df315f55d2747ca4a1ba3cf99bae078ae91ff3a08db87a1ca632223f5e2: Status 404 returned error can't find the container with id 4b267df315f55d2747ca4a1ba3cf99bae078ae91ff3a08db87a1ca632223f5e2 Jul 29 10:21:22.794727 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.794453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.800582 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.800526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/107d8279-51e7-450b-a3bf-fa2e840e8bfe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-gxmx9\" (UID: \"107d8279-51e7-450b-a3bf-fa2e840e8bfe\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:22.879503 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:22.879390 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c65sq" event={"ID":"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc","Type":"ContainerStarted","Data":"4b267df315f55d2747ca4a1ba3cf99bae078ae91ff3a08db87a1ca632223f5e2"} Jul 29 10:21:23.005898 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.005132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" Jul 29 10:21:23.049654 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.049309 2558 patch_prober.go:28] interesting pod/image-registry-b86d986cf-jbzqv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 10:21:23.049654 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.049368 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 10:21:23.139252 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.139221 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:21:23.142553 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.142502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.146012 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.145729 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 10:21:23.147692 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.147221 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 10:21:23.147692 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.147516 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 10:21:23.147872 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.147725 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 10:21:23.148473 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.148325 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4npbw\"" Jul 29 10:21:23.149078 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.148602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 10:21:23.149195 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.149148 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 10:21:23.149428 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.149385 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 10:21:23.149909 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.149549 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 10:21:23.149909 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.149737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 10:21:23.189857 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.189763 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-out\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203114 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv4lz\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-kube-api-access-tv4lz\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203170 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-volume\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-web-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.203603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.203449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304106 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-volume\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304106 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-web-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304323 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-out\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.304603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.304382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.305259 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.305225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv4lz\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-kube-api-access-tv4lz\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.305370 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.305280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.305459 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:23.305443 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle podName:1dd62950-01a5-4f39-bb39-e7cc94887e34 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:23.805419957 +0000 UTC m=+70.767350563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1dd62950-01a5-4f39-bb39-e7cc94887e34") : configmap references non-existent config key: ca-bundle.crt Jul 29 10:21:23.305526 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:23.305451 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 10:21:23.305526 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:23.305515 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls podName:1dd62950-01a5-4f39-bb39-e7cc94887e34 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:23.805497866 +0000 UTC m=+70.767428454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1dd62950-01a5-4f39-bb39-e7cc94887e34") : secret "alertmanager-main-tls" not found Jul 29 10:21:23.305643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.305588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.308059 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.308019 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.308570 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.308519 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.312401 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.312298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-web-config\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.313603 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.313239 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.314029 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.313967 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-out\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.314595 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.314549 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.316616 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.316575 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.317697 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.317633 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-config-volume\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.318100 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.318065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.325011 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.324968 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv4lz\" (UniqueName: \"kubernetes.io/projected/1dd62950-01a5-4f39-bb39-e7cc94887e34-kube-api-access-tv4lz\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.810103 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.809841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.811709 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.811296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:23.811709 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:23.811463 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 10:21:23.811709 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:23.811531 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls podName:1dd62950-01a5-4f39-bb39-e7cc94887e34 nodeName:}" failed. No retries permitted until 2026-07-29 10:21:24.811510073 +0000 UTC m=+71.773440661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1dd62950-01a5-4f39-bb39-e7cc94887e34") : secret "alertmanager-main-tls" not found Jul 29 10:21:23.811709 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:23.811658 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd62950-01a5-4f39-bb39-e7cc94887e34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:24.820895 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:24.820813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:24.824050 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:24.824021 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1dd62950-01a5-4f39-bb39-e7cc94887e34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1dd62950-01a5-4f39-bb39-e7cc94887e34\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:24.957788 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:24.957755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 10:21:25.120841 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.120690 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-546bc96f-vcdr6"] Jul 29 10:21:25.124073 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.124048 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.127923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.127865 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128086 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128212 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128425 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6d6jr8gcahts0\"" Jul 29 10:21:25.128574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.128515 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-stl69\"" Jul 29 10:21:25.136523 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.136501 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546bc96f-vcdr6"] Jul 29 10:21:25.224436 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224399 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrkd\" (UniqueName: \"kubernetes.io/projected/40a34658-9215-4253-b0e1-5727e0651a3d-kube-api-access-wtrkd\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224630 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224630 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a34658-9215-4253-b0e1-5727e0651a3d-metrics-client-ca\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224630 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-grpc-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224630 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224630 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224900 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.224900 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.224730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326122 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326311 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a34658-9215-4253-b0e1-5727e0651a3d-metrics-client-ca\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326311 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-grpc-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326312 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326570 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.326570 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.326499 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrkd\" (UniqueName: \"kubernetes.io/projected/40a34658-9215-4253-b0e1-5727e0651a3d-kube-api-access-wtrkd\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.327660 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.327631 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a34658-9215-4253-b0e1-5727e0651a3d-metrics-client-ca\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.329669 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.329642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.330125 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.330095 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.330125 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.330119 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-grpc-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.330324 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.330303 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.330529 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.330506 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.330988 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.330963 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/40a34658-9215-4253-b0e1-5727e0651a3d-secret-thanos-querier-tls\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.336108 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.336083 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrkd\" (UniqueName: \"kubernetes.io/projected/40a34658-9215-4253-b0e1-5727e0651a3d-kube-api-access-wtrkd\") pod \"thanos-querier-546bc96f-vcdr6\" (UID: \"40a34658-9215-4253-b0e1-5727e0651a3d\") " pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:25.436522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:25.436408 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:26.346503 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.346469 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f7bd46b5-cxbq4"] Jul 29 10:21:26.353916 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.353871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.356780 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.356754 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 10:21:26.356924 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.356812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 10:21:26.356924 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.356824 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 10:21:26.357860 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.357843 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1o4099r3lvrbu\"" Jul 29 10:21:26.357995 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.357951 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qmhlw\"" Jul 29 10:21:26.357995 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.357955 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 10:21:26.364766 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.364723 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f7bd46b5-cxbq4"] Jul 29 10:21:26.438008 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.437972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94f70e70-39c3-4773-a18b-8010bbbc86fc-audit-log\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438172 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-client-certs\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438172 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-metrics-server-audit-profiles\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438172 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-tls\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438340 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-client-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438340 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.438340 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.438301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8t5x\" (UniqueName: \"kubernetes.io/projected/94f70e70-39c3-4773-a18b-8010bbbc86fc-kube-api-access-q8t5x\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539154 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8t5x\" (UniqueName: \"kubernetes.io/projected/94f70e70-39c3-4773-a18b-8010bbbc86fc-kube-api-access-q8t5x\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94f70e70-39c3-4773-a18b-8010bbbc86fc-audit-log\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-client-certs\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-metrics-server-audit-profiles\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539542 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-tls\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539542 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-client-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539755 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/94f70e70-39c3-4773-a18b-8010bbbc86fc-audit-log\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.539973 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.539949 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.540688 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.540662 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/94f70e70-39c3-4773-a18b-8010bbbc86fc-metrics-server-audit-profiles\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.542190 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.542170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-client-certs\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.542302 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.542283 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-secret-metrics-server-tls\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.542359 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.542323 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/94f70e70-39c3-4773-a18b-8010bbbc86fc-client-ca-bundle\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.549251 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.549232 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8t5x\" (UniqueName: \"kubernetes.io/projected/94f70e70-39c3-4773-a18b-8010bbbc86fc-kube-api-access-q8t5x\") pod \"metrics-server-6f7bd46b5-cxbq4\" (UID: \"94f70e70-39c3-4773-a18b-8010bbbc86fc\") " pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.666533 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.666452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:21:26.822669 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.822635 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:21:26.825901 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.825868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.828345 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.828320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 10:21:26.828705 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.828683 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 10:21:26.828705 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.828688 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 10:21:26.828860 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.828733 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9czr8\"" Jul 29 10:21:26.829295 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.829277 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 10:21:26.829407 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.829302 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 10:21:26.841615 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.841592 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:21:26.845138 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.845113 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 10:21:26.943184 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97n98\" (UniqueName: \"kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943184 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:26.943395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:26.943388 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.043948 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.043907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044111 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.043985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97n98\" (UniqueName: \"kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044111 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044111 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044283 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044283 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044150 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.044283 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.045007 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044941 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.045007 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.044948 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.045434 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.045408 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.045531 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.045486 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.047190 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.047169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.047436 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.047416 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.055831 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.055806 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97n98\" (UniqueName: \"kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98\") pod \"console-7fd6474f89-mnnzb\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:27.144016 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:27.143974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:33.046680 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:33.046651 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:35.699670 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:35.699578 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9"] Jul 29 10:21:36.300960 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:36.300925 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107d8279_51e7_450b_a3bf_fa2e840e8bfe.slice/crio-10823e00f765071241b405972eacda4cda7c8ab0945bcfdc6ccf2a119d1d7981 WatchSource:0}: Error finding container 10823e00f765071241b405972eacda4cda7c8ab0945bcfdc6ccf2a119d1d7981: Status 404 returned error can't find the container with id 10823e00f765071241b405972eacda4cda7c8ab0945bcfdc6ccf2a119d1d7981 Jul 29 10:21:36.862384 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:36.862357 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546bc96f-vcdr6"] Jul 29 10:21:36.876514 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:36.876474 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f7bd46b5-cxbq4"] Jul 29 10:21:36.936389 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:36.936342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" event={"ID":"107d8279-51e7-450b-a3bf-fa2e840e8bfe","Type":"ContainerStarted","Data":"10823e00f765071241b405972eacda4cda7c8ab0945bcfdc6ccf2a119d1d7981"} Jul 29 10:21:37.168565 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:37.167931 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f70e70_39c3_4773_a18b_8010bbbc86fc.slice/crio-6cb01c623de1fc86c055ffc3c2770d8f1f6dae3dfab582a85e6eae624ac5a6f9 WatchSource:0}: Error finding container 6cb01c623de1fc86c055ffc3c2770d8f1f6dae3dfab582a85e6eae624ac5a6f9: Status 404 returned error can't find the container with id 6cb01c623de1fc86c055ffc3c2770d8f1f6dae3dfab582a85e6eae624ac5a6f9 Jul 29 10:21:37.168980 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:37.168953 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a34658_9215_4253_b0e1_5727e0651a3d.slice/crio-f542e9e94c96a6b48dec267f668e3b299d2bf23a347a612106bad8dad73066ac WatchSource:0}: Error finding container f542e9e94c96a6b48dec267f668e3b299d2bf23a347a612106bad8dad73066ac: Status 404 returned error can't find the container with id f542e9e94c96a6b48dec267f668e3b299d2bf23a347a612106bad8dad73066ac Jul 29 10:21:37.302185 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.302160 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:21:37.306539 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:37.306515 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95930741_0ff5_4e5b_bfee_241b0cc94cde.slice/crio-e5508ff88a7587f10370a6df2f3453f4dc62ae4947a448d569dc8d7bb7be9e79 WatchSource:0}: Error finding container e5508ff88a7587f10370a6df2f3453f4dc62ae4947a448d569dc8d7bb7be9e79: Status 404 returned error can't find the container with id e5508ff88a7587f10370a6df2f3453f4dc62ae4947a448d569dc8d7bb7be9e79 Jul 29 10:21:37.336581 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.336367 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 10:21:37.344344 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:21:37.344317 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd62950_01a5_4f39_bb39_e7cc94887e34.slice/crio-05edd39f809c3c70b4f30a204722424b813b05be33605d2cd2cce8f157061b26 WatchSource:0}: Error finding container 05edd39f809c3c70b4f30a204722424b813b05be33605d2cd2cce8f157061b26: Status 404 returned error can't find the container with id 05edd39f809c3c70b4f30a204722424b813b05be33605d2cd2cce8f157061b26 Jul 29 10:21:37.946900 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.946345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-prdfr" event={"ID":"6a919ea5-d219-45ac-80ca-268ab3c4e8de","Type":"ContainerStarted","Data":"823d327598748278bb5ad9ae289c7dbdc6969c7ce718df9aa3c445282e3ed77b"} Jul 29 10:21:37.947382 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.947067 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:37.952408 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.951804 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kxwzp" event={"ID":"c3b93cfd-370c-4b07-a767-b72be7e3d4ba","Type":"ContainerStarted","Data":"9920e3dedbb216d94df8d1baa95001f5de98a9886c9a60426126785b61825b0e"} Jul 29 10:21:37.952408 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.952345 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:21:37.956988 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.956741 2558 generic.go:356] "Generic (PLEG): container finished" podID="5ee808d2-e7bd-4191-bb51-7411f7fcb2dc" containerID="1598ec1dd1bdbaeaa89e3f47cf8bf017b8b7b2108e38bf84d6e737b51f651400" exitCode=0 Jul 29 10:21:37.956988 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.956850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c65sq" event={"ID":"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc","Type":"ContainerDied","Data":"1598ec1dd1bdbaeaa89e3f47cf8bf017b8b7b2108e38bf84d6e737b51f651400"} Jul 29 10:21:37.956988 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.956948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-prdfr" Jul 29 10:21:37.968365 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.968265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4pfwd" event={"ID":"a5c4008b-27e2-452f-a05f-244681f5733d","Type":"ContainerStarted","Data":"98d54849f386fd8db8791f9bca2b7a3ddafcba55030a3528e38e6c34c855596e"} Jul 29 10:21:37.971564 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.970197 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-prdfr" podStartSLOduration=1.293766191 podStartE2EDuration="24.970181407s" totalImagesPullingTime="23.676415216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:37.969279683 +0000 UTC m=+84.931210292" watchObservedRunningTime="2026-07-29 10:21:37.970181407 +0000 UTC m=+84.932112015" Jul 29 10:21:37.981585 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.981559 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" event={"ID":"107d8279-51e7-450b-a3bf-fa2e840e8bfe","Type":"ContainerStarted","Data":"68d708aaa8529925185d45faa64c847803249f9d4c33c2117bf4b0d37843472b"} Jul 29 10:21:37.981737 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.981618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" event={"ID":"107d8279-51e7-450b-a3bf-fa2e840e8bfe","Type":"ContainerStarted","Data":"3f593089a36951dd39f50b2bbc20dc4f3517bade578f37589980a15f079cf426"} Jul 29 10:21:37.984201 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.984166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f6lcd" event={"ID":"c6c9065c-0112-490a-876a-2ad60639d743","Type":"ContainerStarted","Data":"10bb80ed674bfde72bb8a4ec5e29018ea68c7a6cc8376995dc842a5c0b88cf92"} Jul 29 10:21:37.987792 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.987717 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6474f89-mnnzb" event={"ID":"95930741-0ff5-4e5b-bfee-241b0cc94cde","Type":"ContainerStarted","Data":"e5508ff88a7587f10370a6df2f3453f4dc62ae4947a448d569dc8d7bb7be9e79"} Jul 29 10:21:37.990229 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.990115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"05edd39f809c3c70b4f30a204722424b813b05be33605d2cd2cce8f157061b26"} Jul 29 10:21:37.993368 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.993294 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" event={"ID":"94f70e70-39c3-4773-a18b-8010bbbc86fc","Type":"ContainerStarted","Data":"6cb01c623de1fc86c055ffc3c2770d8f1f6dae3dfab582a85e6eae624ac5a6f9"} Jul 29 10:21:37.995059 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:37.994971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"f542e9e94c96a6b48dec267f668e3b299d2bf23a347a612106bad8dad73066ac"} Jul 29 10:21:38.039510 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.039445 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kxwzp" podStartSLOduration=68.076025375 podStartE2EDuration="1m25.039422158s" totalImagesPullingTime="16.963396783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:38.038379573 +0000 UTC m=+85.000310185" watchObservedRunningTime="2026-07-29 10:21:38.039422158 +0000 UTC m=+85.001352767" Jul 29 10:21:38.056633 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.055156 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f6lcd" podStartSLOduration=68.097454911 podStartE2EDuration="1m25.055135065s" totalImagesPullingTime="16.957680154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:38.054766396 +0000 UTC m=+85.016697004" watchObservedRunningTime="2026-07-29 10:21:38.055135065 +0000 UTC m=+85.017065691" Jul 29 10:21:38.062296 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.062077 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerName="registry" containerID="cri-o://aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7" gracePeriod=30 Jul 29 10:21:38.400153 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.399895 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:38.562409 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.562310 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563216 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t94k\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563276 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563316 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563382 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563432 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563467 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.563501 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") pod \"c22b8005-757c-4f0d-9920-ed161ab0cce0\" (UID: \"c22b8005-757c-4f0d-9920-ed161ab0cce0\") " Jul 29 10:21:38.564333 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.564181 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:21:38.565568 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.564555 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:21:38.573577 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.573515 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k" (OuterVolumeSpecName: "kube-api-access-8t94k") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "kube-api-access-8t94k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:21:38.576516 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.576486 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:21:38.578279 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.578231 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:21:38.578836 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.578796 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:21:38.579236 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.579199 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:21:38.582424 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.582388 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c22b8005-757c-4f0d-9920-ed161ab0cce0" (UID: "c22b8005-757c-4f0d-9920-ed161ab0cce0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:21:38.665190 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665149 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-installation-pull-secrets\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665190 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665187 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-certificates\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665204 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22b8005-757c-4f0d-9920-ed161ab0cce0-image-registry-private-configuration\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665220 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-registry-tls\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665233 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-bound-sa-token\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665246 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t94k\" (UniqueName: \"kubernetes.io/projected/c22b8005-757c-4f0d-9920-ed161ab0cce0-kube-api-access-8t94k\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665260 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22b8005-757c-4f0d-9920-ed161ab0cce0-ca-trust-extracted\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:38.665429 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:38.665273 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22b8005-757c-4f0d-9920-ed161ab0cce0-trusted-ca\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:21:39.017926 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.017547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c65sq" event={"ID":"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc","Type":"ContainerStarted","Data":"66e6412cca5253f37bcef3aa0562d921b5db899edb62a5b7aff386c675fe8092"} Jul 29 10:21:39.017926 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.017658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c65sq" event={"ID":"5ee808d2-e7bd-4191-bb51-7411f7fcb2dc","Type":"ContainerStarted","Data":"61b1a15f1d4278fd928c3c9abdc219aa67d6fa4c6f9b3389556b87c34416b49c"} Jul 29 10:21:39.028905 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.024765 2558 generic.go:356] "Generic (PLEG): container finished" podID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerID="aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7" exitCode=0 Jul 29 10:21:39.028905 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.025367 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" Jul 29 10:21:39.030234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.029223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" event={"ID":"c22b8005-757c-4f0d-9920-ed161ab0cce0","Type":"ContainerDied","Data":"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7"} Jul 29 10:21:39.030234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.029270 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b86d986cf-jbzqv" event={"ID":"c22b8005-757c-4f0d-9920-ed161ab0cce0","Type":"ContainerDied","Data":"725b22f8d229b47ee0e243fdff0443d0fe29727c4951c2815a7977efd473b285"} Jul 29 10:21:39.030234 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.029295 2558 scope.go:117] "RemoveContainer" containerID="aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7" Jul 29 10:21:39.059916 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.059731 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c65sq" podStartSLOduration=2.105195228 podStartE2EDuration="17.059708463s" totalImagesPullingTime="14.854973025s" totalInitContainerRuntime="99.54021ms" isStatefulPod=true podCreationTimestamp="2026-07-29 10:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:39.043538088 +0000 UTC m=+86.005468699" watchObservedRunningTime="2026-07-29 10:21:39.059708463 +0000 UTC m=+86.021639073" Jul 29 10:21:39.060398 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.060346 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:21:39.064030 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.063971 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b86d986cf-jbzqv"] Jul 29 10:21:39.584549 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:39.584512 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" path="/var/lib/kubelet/pods/c22b8005-757c-4f0d-9920-ed161ab0cce0/volumes" Jul 29 10:21:40.018272 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:40.018247 2558 scope.go:117] "RemoveContainer" containerID="aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7" Jul 29 10:21:40.019794 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:21:40.019763 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7\": container with ID starting with aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7 not found: ID does not exist" containerID="aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7" Jul 29 10:21:40.019913 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:40.019805 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7"} err="failed to get container status \"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7\": rpc error: code = NotFound desc = could not find container \"aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7\": container with ID starting with aa9f4638e649cf78c9722f1beeb7149ae55fae4e248d47c672cde82e7b6b99d7 not found: ID does not exist" Jul 29 10:21:48.070111 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.070028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6474f89-mnnzb" event={"ID":"95930741-0ff5-4e5b-bfee-241b0cc94cde","Type":"ContainerStarted","Data":"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f"} Jul 29 10:21:48.071537 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.071511 2558 generic.go:356] "Generic (PLEG): container finished" podID="1dd62950-01a5-4f39-bb39-e7cc94887e34" containerID="0f9ffb276a561127204467b46ad17abde683db7029927ca0baba1ae16159e878" exitCode=0 Jul 29 10:21:48.071668 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.071598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerDied","Data":"0f9ffb276a561127204467b46ad17abde683db7029927ca0baba1ae16159e878"} Jul 29 10:21:48.073188 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.073164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" event={"ID":"94f70e70-39c3-4773-a18b-8010bbbc86fc","Type":"ContainerStarted","Data":"574235c499b8dd951cbb319f57763543499be3aa15ec24b2d125a6731471fa1d"} Jul 29 10:21:48.075513 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.075492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"fd8e9d5f8a3796d9d11fecfb96ef8b2188c11dcd9c63ad18fb52ecee73eddc95"} Jul 29 10:21:48.075602 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.075559 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"8775190684bcc62c23bdb3034adcc1ee59de54b7c735b4058c344f7506ee0727"} Jul 29 10:21:48.075653 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.075602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"e79528d694b5d846207feade348e9d32eac77a4c5b60606743b29d819450de5e"} Jul 29 10:21:48.077260 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.077241 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4pfwd" event={"ID":"a5c4008b-27e2-452f-a05f-244681f5733d","Type":"ContainerStarted","Data":"aa538c180b57a251e64e436c0303d2ec5b35b4a541344b8be7340c60a3e02175"} Jul 29 10:21:48.079476 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.079454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" event={"ID":"107d8279-51e7-450b-a3bf-fa2e840e8bfe","Type":"ContainerStarted","Data":"6a7b99df81fda23fcab7b6c8a9fb8e341a6b75b85a9f915a32179cbc9b87919d"} Jul 29 10:21:48.091696 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.091657 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd6474f89-mnnzb" podStartSLOduration=12.324320372 podStartE2EDuration="22.091646023s" totalImagesPullingTime="9.767325651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:48.090247901 +0000 UTC m=+95.052178510" watchObservedRunningTime="2026-07-29 10:21:48.091646023 +0000 UTC m=+95.053576630" Jul 29 10:21:48.108445 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.108408 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-gxmx9" podStartSLOduration=16.92750719 podStartE2EDuration="26.10839575s" totalImagesPullingTime="9.18088856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:48.107632674 +0000 UTC m=+95.069563282" watchObservedRunningTime="2026-07-29 10:21:48.10839575 +0000 UTC m=+95.070326357" Jul 29 10:21:48.157079 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:48.157038 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" podStartSLOduration=12.381057403 podStartE2EDuration="22.157021918s" totalImagesPullingTime="9.775964515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:48.156295364 +0000 UTC m=+95.118225975" watchObservedRunningTime="2026-07-29 10:21:48.157021918 +0000 UTC m=+95.118952526" Jul 29 10:21:53.102310 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"5b8197014ad65a7962870494e4a9dcf916d6206f0443f16cbef0020abd86cfa1"} Jul 29 10:21:53.102793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"97f2a6164ea57d926fa4484f71e2d3def130dde01322b2aeb21eac0ff4e50729"} Jul 29 10:21:53.102793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102431 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"459e40e1e4e776c202d788fe6c14589d1155d029e1211dcdbe6ff36988969a24"} Jul 29 10:21:53.102793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102457 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"01297a79ddf9dbba1ba82e41508a482f9f4375f20efba71cdaea7d5800d3e543"} Jul 29 10:21:53.102793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102490 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"0777255a4b65d1fef3c1180a4fdd8ce1050f6a243b7ef8f6b90b2d7a88380d5d"} Jul 29 10:21:53.102793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.102515 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1dd62950-01a5-4f39-bb39-e7cc94887e34","Type":"ContainerStarted","Data":"cb380f19faedfe99daeee9e7e39dbc4d3810ac703f6e3cc5140f9f581b633a94"} Jul 29 10:21:53.105485 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.105461 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"b7319d126dbde5f3970aaaf73a1110599d354afd44b77bd2daa79354d61aa094"} Jul 29 10:21:53.105624 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.105532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"8468397b0dac6ffc89661c42954e31129cd255f3334bc59f6e1f22f04d5a84de"} Jul 29 10:21:53.105624 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.105578 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" event={"ID":"40a34658-9215-4253-b0e1-5727e0651a3d","Type":"ContainerStarted","Data":"d48a54b7a16d69642f60d873af5230fd5c6c6662f40fcfb43312d93d3f486f91"} Jul 29 10:21:53.105624 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.105623 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:53.107625 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.107598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4pfwd" event={"ID":"a5c4008b-27e2-452f-a05f-244681f5733d","Type":"ContainerStarted","Data":"c547d14a0c8314d97c2fbd3e78fe03bff9499c3eb546312c0ee2a1f4fea756dd"} Jul 29 10:21:53.111828 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.111806 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" Jul 29 10:21:53.133435 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.133398 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=16.231102401 podStartE2EDuration="30.133386565s" totalImagesPullingTime="13.894425846s" totalInitContainerRuntime="7.858318ms" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:53.132775581 +0000 UTC m=+100.094706199" watchObservedRunningTime="2026-07-29 10:21:53.133386565 +0000 UTC m=+100.095317173" Jul 29 10:21:53.152258 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.152212 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4pfwd" podStartSLOduration=34.051631637 podStartE2EDuration="1m5.152192996s" totalImagesPullingTime="31.100561359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:20:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:53.150800501 +0000 UTC m=+100.112731108" watchObservedRunningTime="2026-07-29 10:21:53.152192996 +0000 UTC m=+100.114123605" Jul 29 10:21:53.177322 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:53.177280 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-546bc96f-vcdr6" podStartSLOduration=16.49657759 podStartE2EDuration="28.177265241s" totalImagesPullingTime="11.680687651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:21:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:21:53.175537572 +0000 UTC m=+100.137468206" watchObservedRunningTime="2026-07-29 10:21:53.177265241 +0000 UTC m=+100.139195849" Jul 29 10:21:57.144725 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:57.144679 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:57.145210 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:57.144746 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:57.149460 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:57.149440 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:21:58.138037 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:21:58.138010 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:22:06.667567 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:06.667538 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:22:06.668047 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:06.667591 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:22:10.036801 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:10.036768 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kxwzp" Jul 29 10:22:26.672256 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:26.672229 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:22:26.676080 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:26.676059 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f7bd46b5-cxbq4" Jul 29 10:22:46.456049 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.456014 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b968d5bff-km64q"] Jul 29 10:22:46.457098 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.457072 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerName="registry" Jul 29 10:22:46.457098 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.457094 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerName="registry" Jul 29 10:22:46.457290 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.457152 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22b8005-757c-4f0d-9920-ed161ab0cce0" containerName="registry" Jul 29 10:22:46.459432 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.459415 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.462113 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.462091 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 10:22:46.462215 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.462198 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 10:22:46.462595 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.462578 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bj2rd\"" Jul 29 10:22:46.462657 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.462642 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 10:22:46.463086 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.463073 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 10:22:46.463132 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.463106 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 10:22:46.469566 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.469548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 10:22:46.473497 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.473478 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b968d5bff-km64q"] Jul 29 10:22:46.608410 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lwxl\" (UniqueName: \"kubernetes.io/projected/313acaab-f859-4743-b72e-b6aafd78e4a7-kube-api-access-8lwxl\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608410 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608627 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608436 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608627 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608525 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608627 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-metrics-client-ca\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608627 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608752 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-federate-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.608752 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.608680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-serving-certs-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709383 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lwxl\" (UniqueName: \"kubernetes.io/projected/313acaab-f859-4743-b72e-b6aafd78e4a7-kube-api-access-8lwxl\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709383 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709334 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709383 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-metrics-client-ca\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-federate-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.709655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.709548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-serving-certs-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.710348 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.710318 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-serving-certs-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.710535 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.710508 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.710618 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.710558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/313acaab-f859-4743-b72e-b6aafd78e4a7-metrics-client-ca\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.712036 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.712006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.712143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.712056 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-secret-telemeter-client\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.712143 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.712124 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-telemeter-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.712257 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.712181 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/313acaab-f859-4743-b72e-b6aafd78e4a7-federate-client-tls\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.720167 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.720143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lwxl\" (UniqueName: \"kubernetes.io/projected/313acaab-f859-4743-b72e-b6aafd78e4a7-kube-api-access-8lwxl\") pod \"telemeter-client-6b968d5bff-km64q\" (UID: \"313acaab-f859-4743-b72e-b6aafd78e4a7\") " pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.771991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.771941 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" Jul 29 10:22:46.904321 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:46.904299 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b968d5bff-km64q"] Jul 29 10:22:46.906500 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:22:46.906475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313acaab_f859_4743_b72e_b6aafd78e4a7.slice/crio-c2869aaef886600eb128b27b92c4deddf59a4da0cbe54fe87a8579709931b80d WatchSource:0}: Error finding container c2869aaef886600eb128b27b92c4deddf59a4da0cbe54fe87a8579709931b80d: Status 404 returned error can't find the container with id c2869aaef886600eb128b27b92c4deddf59a4da0cbe54fe87a8579709931b80d Jul 29 10:22:47.319237 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:47.319205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" event={"ID":"313acaab-f859-4743-b72e-b6aafd78e4a7","Type":"ContainerStarted","Data":"c2869aaef886600eb128b27b92c4deddf59a4da0cbe54fe87a8579709931b80d"} Jul 29 10:22:49.329142 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:49.329108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" event={"ID":"313acaab-f859-4743-b72e-b6aafd78e4a7","Type":"ContainerStarted","Data":"d1c9cbfb7a560031d51671a5008aa10dc1ec191a7f38212ba833d8f7453e2a83"} Jul 29 10:22:49.329523 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:49.329196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" event={"ID":"313acaab-f859-4743-b72e-b6aafd78e4a7","Type":"ContainerStarted","Data":"22f9f755612c99994d4bab19bde57ee0f8ad02d7acd2988f6f9d96663aeee3e7"} Jul 29 10:22:49.329523 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:49.329216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" event={"ID":"313acaab-f859-4743-b72e-b6aafd78e4a7","Type":"ContainerStarted","Data":"569675a450a450112c7d5ad090222f38df806bface4277c3ec50016f66254772"} Jul 29 10:22:49.356972 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:49.356923 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b968d5bff-km64q" podStartSLOduration=1.7512786359999999 podStartE2EDuration="3.356906245s" totalImagesPullingTime="1.605627609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:22:49.356061911 +0000 UTC m=+156.317992520" watchObservedRunningTime="2026-07-29 10:22:49.356906245 +0000 UTC m=+156.318836852" Jul 29 10:22:50.237373 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.237336 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:22:50.239509 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.239488 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.252622 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.252603 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:22:50.344078 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j846d\" (UniqueName: \"kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344326 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.344526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.344375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.445758 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.445697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.445758 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.445768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446061 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.445933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446061 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446176 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446233 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j846d\" (UniqueName: \"kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446286 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446665 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446485 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446869 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446845 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446975 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446865 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.446975 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.446865 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.448313 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.448293 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.448463 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.448443 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.456418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.456401 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j846d\" (UniqueName: \"kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d\") pod \"console-998bb4f45-47zlz\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.547816 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.547719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:22:50.675111 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:50.675090 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:22:50.677437 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:22:50.677415 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91fffa1_8291_42f9_b6dd_831d20aef5e3.slice/crio-ba19baac4bcd4a02d323f34f09ae36c99bdea8d0cdf4372e98aa65ee24336de0 WatchSource:0}: Error finding container ba19baac4bcd4a02d323f34f09ae36c99bdea8d0cdf4372e98aa65ee24336de0: Status 404 returned error can't find the container with id ba19baac4bcd4a02d323f34f09ae36c99bdea8d0cdf4372e98aa65ee24336de0 Jul 29 10:22:51.338200 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:51.338164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998bb4f45-47zlz" event={"ID":"d91fffa1-8291-42f9-b6dd-831d20aef5e3","Type":"ContainerStarted","Data":"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3"} Jul 29 10:22:51.338396 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:51.338215 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998bb4f45-47zlz" event={"ID":"d91fffa1-8291-42f9-b6dd-831d20aef5e3","Type":"ContainerStarted","Data":"ba19baac4bcd4a02d323f34f09ae36c99bdea8d0cdf4372e98aa65ee24336de0"} Jul 29 10:22:51.363324 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:22:51.363278 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-998bb4f45-47zlz" podStartSLOduration=1.363262417 podStartE2EDuration="1.363262417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:22:51.361468614 +0000 UTC m=+158.323399246" watchObservedRunningTime="2026-07-29 10:22:51.363262417 +0000 UTC m=+158.325193024" Jul 29 10:23:00.548692 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:00.548639 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:00.549312 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:00.548728 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:00.553559 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:00.553537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:01.380242 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.380217 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:01.445438 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.445405 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:23:01.612461 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.612427 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:23:01.615150 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.615135 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.635908 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.635818 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:23:01.744683 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.744870 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjh8\" (UniqueName: \"kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.744870 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.744870 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.745047 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.745047 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.745047 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.744995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.845713 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.845861 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjh8\" (UniqueName: \"kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.845861 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.845974 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.845974 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845960 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846068 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.845992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846068 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.846013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846578 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.846555 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846687 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.846626 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846762 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.846740 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.846858 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.846843 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.848308 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.848287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.848392 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.848321 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.856406 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.856379 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjh8\" (UniqueName: \"kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8\") pod \"console-7b656bd9c6-rthsg\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:01.924628 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:01.924554 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:02.064906 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:02.062660 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:23:02.069125 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:23:02.069097 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4634e803_0173_43d4_a088_f83631f23c1a.slice/crio-8a06cc25ab621333f9efef04e0612c56dfa6b5f83bf04407b3b6067e20701b1c WatchSource:0}: Error finding container 8a06cc25ab621333f9efef04e0612c56dfa6b5f83bf04407b3b6067e20701b1c: Status 404 returned error can't find the container with id 8a06cc25ab621333f9efef04e0612c56dfa6b5f83bf04407b3b6067e20701b1c Jul 29 10:23:02.382151 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:02.382111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b656bd9c6-rthsg" event={"ID":"4634e803-0173-43d4-a088-f83631f23c1a","Type":"ContainerStarted","Data":"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44"} Jul 29 10:23:02.382307 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:02.382168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b656bd9c6-rthsg" event={"ID":"4634e803-0173-43d4-a088-f83631f23c1a","Type":"ContainerStarted","Data":"8a06cc25ab621333f9efef04e0612c56dfa6b5f83bf04407b3b6067e20701b1c"} Jul 29 10:23:02.411816 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:02.411764 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b656bd9c6-rthsg" podStartSLOduration=1.411748491 podStartE2EDuration="1.411748491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:23:02.409570074 +0000 UTC m=+169.371500681" watchObservedRunningTime="2026-07-29 10:23:02.411748491 +0000 UTC m=+169.373679107" Jul 29 10:23:11.925090 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:11.924994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:11.925090 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:11.925059 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:11.929480 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:11.929458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:12.425269 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:12.425236 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:23:12.471928 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:12.471901 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:23:26.464095 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.464057 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fd6474f89-mnnzb" podUID="95930741-0ff5-4e5b-bfee-241b0cc94cde" containerName="console" containerID="cri-o://e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f" gracePeriod=15 Jul 29 10:23:26.706688 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.706665 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:23:26.756130 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756056 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756130 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756096 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756130 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756117 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756168 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756211 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756267 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756296 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97n98\" (UniqueName: \"kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98\") pod \"95930741-0ff5-4e5b-bfee-241b0cc94cde\" (UID: \"95930741-0ff5-4e5b-bfee-241b0cc94cde\") " Jul 29 10:23:26.756609 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756468 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca" (OuterVolumeSpecName: "service-ca") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:26.756668 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756627 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config" (OuterVolumeSpecName: "console-config") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:26.756707 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756666 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:26.756707 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.756686 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:26.758488 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.758460 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98" (OuterVolumeSpecName: "kube-api-access-97n98") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "kube-api-access-97n98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:23:26.758488 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.758471 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:23:26.758621 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.758504 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95930741-0ff5-4e5b-bfee-241b0cc94cde" (UID: "95930741-0ff5-4e5b-bfee-241b0cc94cde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:23:26.857749 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857710 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-trusted-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.857749 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857741 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97n98\" (UniqueName: \"kubernetes.io/projected/95930741-0ff5-4e5b-bfee-241b0cc94cde-kube-api-access-97n98\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.857749 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857751 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-service-ca\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.857749 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857759 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.858067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857768 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-oauth-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.858067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857778 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95930741-0ff5-4e5b-bfee-241b0cc94cde-console-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:26.858067 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:26.857785 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95930741-0ff5-4e5b-bfee-241b0cc94cde-oauth-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:27.488522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.488467 2558 generic.go:356] "Generic (PLEG): container finished" podID="95930741-0ff5-4e5b-bfee-241b0cc94cde" containerID="e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f" exitCode=0 Jul 29 10:23:27.488522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.488518 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6474f89-mnnzb" Jul 29 10:23:27.489058 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.488550 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6474f89-mnnzb" event={"ID":"95930741-0ff5-4e5b-bfee-241b0cc94cde","Type":"ContainerDied","Data":"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f"} Jul 29 10:23:27.489058 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.488617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6474f89-mnnzb" event={"ID":"95930741-0ff5-4e5b-bfee-241b0cc94cde","Type":"ContainerDied","Data":"e5508ff88a7587f10370a6df2f3453f4dc62ae4947a448d569dc8d7bb7be9e79"} Jul 29 10:23:27.489058 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.488639 2558 scope.go:117] "RemoveContainer" containerID="e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f" Jul 29 10:23:27.497363 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.497345 2558 scope.go:117] "RemoveContainer" containerID="e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f" Jul 29 10:23:27.497594 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:23:27.497578 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f\": container with ID starting with e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f not found: ID does not exist" containerID="e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f" Jul 29 10:23:27.497647 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.497600 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f"} err="failed to get container status \"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f\": rpc error: code = NotFound desc = could not find container \"e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f\": container with ID starting with e9b8a50855a9f8a06fd54aafde06c14651cba9a7be3891c7ae2b7402165ee82f not found: ID does not exist" Jul 29 10:23:27.513127 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.513108 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:23:27.518146 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.518125 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd6474f89-mnnzb"] Jul 29 10:23:27.572449 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:27.572417 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95930741-0ff5-4e5b-bfee-241b0cc94cde" path="/var/lib/kubelet/pods/95930741-0ff5-4e5b-bfee-241b0cc94cde/volumes" Jul 29 10:23:37.491219 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.491180 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-998bb4f45-47zlz" podUID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" containerName="console" containerID="cri-o://1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3" gracePeriod=15 Jul 29 10:23:37.736636 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.736609 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:37.853270 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853242 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853433 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853291 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853433 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853332 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853433 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853369 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853433 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j846d\" (UniqueName: \"kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853447 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853623 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853500 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert\") pod \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\" (UID: \"d91fffa1-8291-42f9-b6dd-831d20aef5e3\") " Jul 29 10:23:37.853863 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853829 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config" (OuterVolumeSpecName: "console-config") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:37.854080 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.853852 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:37.854080 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.854020 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:37.854198 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.854089 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:23:37.855522 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.855492 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:23:37.855628 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.855523 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:23:37.855628 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.855609 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d" (OuterVolumeSpecName: "kube-api-access-j846d") pod "d91fffa1-8291-42f9-b6dd-831d20aef5e3" (UID: "d91fffa1-8291-42f9-b6dd-831d20aef5e3"). InnerVolumeSpecName "kube-api-access-j846d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:23:37.954136 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954102 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-oauth-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954136 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954128 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954136 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954137 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-service-ca\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954136 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954145 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-trusted-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954377 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954155 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j846d\" (UniqueName: \"kubernetes.io/projected/d91fffa1-8291-42f9-b6dd-831d20aef5e3-kube-api-access-j846d\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954377 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954163 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d91fffa1-8291-42f9-b6dd-831d20aef5e3-oauth-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:37.954377 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:37.954171 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d91fffa1-8291-42f9-b6dd-831d20aef5e3-console-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:23:38.532407 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.532372 2558 generic.go:356] "Generic (PLEG): container finished" podID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" containerID="1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3" exitCode=0 Jul 29 10:23:38.532793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.532421 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998bb4f45-47zlz" Jul 29 10:23:38.532793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.532457 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998bb4f45-47zlz" event={"ID":"d91fffa1-8291-42f9-b6dd-831d20aef5e3","Type":"ContainerDied","Data":"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3"} Jul 29 10:23:38.532793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.532531 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998bb4f45-47zlz" event={"ID":"d91fffa1-8291-42f9-b6dd-831d20aef5e3","Type":"ContainerDied","Data":"ba19baac4bcd4a02d323f34f09ae36c99bdea8d0cdf4372e98aa65ee24336de0"} Jul 29 10:23:38.532793 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.532553 2558 scope.go:117] "RemoveContainer" containerID="1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3" Jul 29 10:23:38.541040 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.541025 2558 scope.go:117] "RemoveContainer" containerID="1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3" Jul 29 10:23:38.541277 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:23:38.541259 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3\": container with ID starting with 1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3 not found: ID does not exist" containerID="1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3" Jul 29 10:23:38.541341 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.541284 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3"} err="failed to get container status \"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3\": rpc error: code = NotFound desc = could not find container \"1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3\": container with ID starting with 1696e30fb2cd7a13cf3e716c8631c236e06e104be16c36d67b567839ca80d3f3 not found: ID does not exist" Jul 29 10:23:38.556205 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.556181 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:23:38.560491 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:38.560472 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-998bb4f45-47zlz"] Jul 29 10:23:39.572890 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:23:39.572843 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" path="/var/lib/kubelet/pods/d91fffa1-8291-42f9-b6dd-831d20aef5e3/volumes" Jul 29 10:24:06.721280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721245 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf"] Jul 29 10:24:06.721776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721669 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95930741-0ff5-4e5b-bfee-241b0cc94cde" containerName="console" Jul 29 10:24:06.721776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721686 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95930741-0ff5-4e5b-bfee-241b0cc94cde" containerName="console" Jul 29 10:24:06.721776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721707 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" containerName="console" Jul 29 10:24:06.721776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721715 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" containerName="console" Jul 29 10:24:06.722037 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721798 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91fffa1-8291-42f9-b6dd-831d20aef5e3" containerName="console" Jul 29 10:24:06.722037 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.721815 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95930741-0ff5-4e5b-bfee-241b0cc94cde" containerName="console" Jul 29 10:24:06.724770 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.724750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.727213 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.727191 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 10:24:06.728167 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.728153 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 10:24:06.728265 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.728173 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cbrj5\"" Jul 29 10:24:06.734356 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.734336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf"] Jul 29 10:24:06.778599 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.778561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.778776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.778632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.778776 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.778675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzkgd\" (UniqueName: \"kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.880131 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.880077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.880280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.880181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.880280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.880232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkgd\" (UniqueName: \"kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.880537 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.880517 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.880572 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.880527 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:06.890473 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:06.890443 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzkgd\" (UniqueName: \"kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:07.034358 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:07.034260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:07.160495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:07.160469 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf"] Jul 29 10:24:07.163488 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:07.163463 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6ac3f3_9566_4024_bb04_e1a0352a051d.slice/crio-99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194 WatchSource:0}: Error finding container 99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194: Status 404 returned error can't find the container with id 99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194 Jul 29 10:24:07.643598 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:07.643564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerStarted","Data":"99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194"} Jul 29 10:24:13.669526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:13.669488 2558 generic.go:356] "Generic (PLEG): container finished" podID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerID="98326cf5ce6473e3538b21dfb767dcc88c42a2b2cd584b77343df3026b3faa07" exitCode=0 Jul 29 10:24:13.669526 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:13.669526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerDied","Data":"98326cf5ce6473e3538b21dfb767dcc88c42a2b2cd584b77343df3026b3faa07"} Jul 29 10:24:15.681283 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:15.681251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerStarted","Data":"e2c275e24888465000d3eebcb4728719139b414d246bd4ddc462f32148cd3ac9"} Jul 29 10:24:16.686088 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:16.686057 2558 generic.go:356] "Generic (PLEG): container finished" podID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerID="e2c275e24888465000d3eebcb4728719139b414d246bd4ddc462f32148cd3ac9" exitCode=0 Jul 29 10:24:16.686507 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:16.686140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerDied","Data":"e2c275e24888465000d3eebcb4728719139b414d246bd4ddc462f32148cd3ac9"} Jul 29 10:24:24.725688 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:24.725652 2558 generic.go:356] "Generic (PLEG): container finished" podID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerID="e29729a5ff269995f040b00eb12ca971e45cebdd23c390f18987cf9c54b0fdf7" exitCode=0 Jul 29 10:24:24.726158 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:24.725694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerDied","Data":"e29729a5ff269995f040b00eb12ca971e45cebdd23c390f18987cf9c54b0fdf7"} Jul 29 10:24:25.853904 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.853870 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:25.961726 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.961695 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzkgd\" (UniqueName: \"kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd\") pod \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " Jul 29 10:24:25.961910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.961737 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util\") pod \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " Jul 29 10:24:25.961910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.961764 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle\") pod \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\" (UID: \"0b6ac3f3-9566-4024-bb04-e1a0352a051d\") " Jul 29 10:24:25.962402 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.962371 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle" (OuterVolumeSpecName: "bundle") pod "0b6ac3f3-9566-4024-bb04-e1a0352a051d" (UID: "0b6ac3f3-9566-4024-bb04-e1a0352a051d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:24:25.963827 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.963804 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd" (OuterVolumeSpecName: "kube-api-access-kzkgd") pod "0b6ac3f3-9566-4024-bb04-e1a0352a051d" (UID: "0b6ac3f3-9566-4024-bb04-e1a0352a051d"). InnerVolumeSpecName "kube-api-access-kzkgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:24:25.967799 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:25.967776 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util" (OuterVolumeSpecName: "util") pod "0b6ac3f3-9566-4024-bb04-e1a0352a051d" (UID: "0b6ac3f3-9566-4024-bb04-e1a0352a051d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:24:26.063434 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.063357 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzkgd\" (UniqueName: \"kubernetes.io/projected/0b6ac3f3-9566-4024-bb04-e1a0352a051d-kube-api-access-kzkgd\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:26.063434 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.063386 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-util\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:26.063434 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.063396 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b6ac3f3-9566-4024-bb04-e1a0352a051d-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:26.734575 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.734535 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" event={"ID":"0b6ac3f3-9566-4024-bb04-e1a0352a051d","Type":"ContainerDied","Data":"99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194"} Jul 29 10:24:26.734575 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.734557 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kflgf" Jul 29 10:24:26.734777 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:26.734586 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99320cc8481deae1d7762ddd3596336fe275649fcb1561e9368282bae16df194" Jul 29 10:24:34.808011 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.807975 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t"] Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808272 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="pull" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808282 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="pull" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808296 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="util" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808303 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="util" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808313 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="extract" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808318 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="extract" Jul 29 10:24:34.808386 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.808369 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6ac3f3-9566-4024-bb04-e1a0352a051d" containerName="extract" Jul 29 10:24:34.811280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.811265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:34.813850 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.813832 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:24:34.814146 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.814127 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-89c74\"" Jul 29 10:24:34.814200 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.814190 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 29 10:24:34.823931 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.823913 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t"] Jul 29 10:24:34.936218 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.936186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b2128d-cd73-4e84-8dbb-343241c67f39-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:34.936218 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:34.936218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfn4h\" (UniqueName: \"kubernetes.io/projected/a0b2128d-cd73-4e84-8dbb-343241c67f39-kube-api-access-bfn4h\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.036733 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.036698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b2128d-cd73-4e84-8dbb-343241c67f39-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.036923 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.036736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfn4h\" (UniqueName: \"kubernetes.io/projected/a0b2128d-cd73-4e84-8dbb-343241c67f39-kube-api-access-bfn4h\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.037099 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.037080 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0b2128d-cd73-4e84-8dbb-343241c67f39-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.046478 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.046455 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfn4h\" (UniqueName: \"kubernetes.io/projected/a0b2128d-cd73-4e84-8dbb-343241c67f39-kube-api-access-bfn4h\") pod \"cert-manager-operator-controller-manager-56b4598547-npw4t\" (UID: \"a0b2128d-cd73-4e84-8dbb-343241c67f39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.120457 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.120437 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" Jul 29 10:24:35.260747 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.260716 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t"] Jul 29 10:24:35.264627 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:35.264605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b2128d_cd73_4e84_8dbb_343241c67f39.slice/crio-b4bbf048bb480caf871c56273e3efb1aa6fe8eea6ce5234c34d09fe6e702b012 WatchSource:0}: Error finding container b4bbf048bb480caf871c56273e3efb1aa6fe8eea6ce5234c34d09fe6e702b012: Status 404 returned error can't find the container with id b4bbf048bb480caf871c56273e3efb1aa6fe8eea6ce5234c34d09fe6e702b012 Jul 29 10:24:35.777891 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:35.777849 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" event={"ID":"a0b2128d-cd73-4e84-8dbb-343241c67f39","Type":"ContainerStarted","Data":"b4bbf048bb480caf871c56273e3efb1aa6fe8eea6ce5234c34d09fe6e702b012"} Jul 29 10:24:37.787701 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:37.787671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" event={"ID":"a0b2128d-cd73-4e84-8dbb-343241c67f39","Type":"ContainerStarted","Data":"1629a98295431aac97e15d31b7a50c410c9ff87b8741efb50151a7a133b29b74"} Jul 29 10:24:37.811410 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:37.811364 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-npw4t" podStartSLOduration=2.22735949 podStartE2EDuration="3.811349987s" totalImagesPullingTime="1.583990497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:24:37.808979466 +0000 UTC m=+264.770910089" watchObservedRunningTime="2026-07-29 10:24:37.811349987 +0000 UTC m=+264.773280594" Jul 29 10:24:38.593853 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.593822 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sth67"] Jul 29 10:24:38.597115 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.597100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.599585 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.599555 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 29 10:24:38.600433 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.600417 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-frn9s\"" Jul 29 10:24:38.600497 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.600452 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 29 10:24:38.606905 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.606871 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sth67"] Jul 29 10:24:38.666173 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.666137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.666343 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.666245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrl8k\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-kube-api-access-rrl8k\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.767491 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.767456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrl8k\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-kube-api-access-rrl8k\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.767661 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.767508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.776770 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.776732 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.776910 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.776844 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrl8k\" (UniqueName: \"kubernetes.io/projected/6a709287-51c1-4df6-968c-c6b8a51957f6-kube-api-access-rrl8k\") pod \"cert-manager-webhook-6486ffd997-sth67\" (UID: \"6a709287-51c1-4df6-968c-c6b8a51957f6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:38.920851 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:38.920755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:39.072990 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:39.072820 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sth67"] Jul 29 10:24:39.075647 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:39.075624 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a709287_51c1_4df6_968c_c6b8a51957f6.slice/crio-5226edcd69a173830353668496fbdd25446897748b431abbac6ff9c9ba5e2520 WatchSource:0}: Error finding container 5226edcd69a173830353668496fbdd25446897748b431abbac6ff9c9ba5e2520: Status 404 returned error can't find the container with id 5226edcd69a173830353668496fbdd25446897748b431abbac6ff9c9ba5e2520 Jul 29 10:24:39.798163 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:39.798125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" event={"ID":"6a709287-51c1-4df6-968c-c6b8a51957f6","Type":"ContainerStarted","Data":"5226edcd69a173830353668496fbdd25446897748b431abbac6ff9c9ba5e2520"} Jul 29 10:24:40.640787 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.640745 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt"] Jul 29 10:24:40.644171 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.644147 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.646913 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.646891 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gl2bd\"" Jul 29 10:24:40.654686 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.654662 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt"] Jul 29 10:24:40.682838 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.682809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.682985 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.682847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqsgb\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-kube-api-access-qqsgb\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.784194 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.784133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.784194 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.784181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqsgb\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-kube-api-access-qqsgb\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.795401 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.795342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.796267 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.796247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqsgb\" (UniqueName: \"kubernetes.io/projected/5a430909-363e-4925-98f1-d381587c0753-kube-api-access-qqsgb\") pod \"cert-manager-cainjector-559cdd8c87-d8lzt\" (UID: \"5a430909-363e-4925-98f1-d381587c0753\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:40.955360 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:40.955275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" Jul 29 10:24:41.599643 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.599614 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt"] Jul 29 10:24:41.602998 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:41.602974 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a430909_363e_4925_98f1_d381587c0753.slice/crio-ce5ab9b002e7d9f3738baf21413514f868e6fdf0c1cc76b9300204bebaef2056 WatchSource:0}: Error finding container ce5ab9b002e7d9f3738baf21413514f868e6fdf0c1cc76b9300204bebaef2056: Status 404 returned error can't find the container with id ce5ab9b002e7d9f3738baf21413514f868e6fdf0c1cc76b9300204bebaef2056 Jul 29 10:24:41.809224 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.809130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" event={"ID":"6a709287-51c1-4df6-968c-c6b8a51957f6","Type":"ContainerStarted","Data":"fc4a1d04ece6c8b61138fa276b4b3a7ba5f880665f30a11632c9c44519da0f2c"} Jul 29 10:24:41.809224 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.809204 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:41.810777 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.810752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" event={"ID":"5a430909-363e-4925-98f1-d381587c0753","Type":"ContainerStarted","Data":"ec82ebfbceed59faaaa82020e8fcf5be73e94f9d17756ca72f096fafc6175703"} Jul 29 10:24:41.810898 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.810785 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" event={"ID":"5a430909-363e-4925-98f1-d381587c0753","Type":"ContainerStarted","Data":"ce5ab9b002e7d9f3738baf21413514f868e6fdf0c1cc76b9300204bebaef2056"} Jul 29 10:24:41.839934 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.839887 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" podStartSLOduration=1.382698617 podStartE2EDuration="3.839857109s" totalImagesPullingTime="2.457158492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:24:41.838632336 +0000 UTC m=+268.800562945" watchObservedRunningTime="2026-07-29 10:24:41.839857109 +0000 UTC m=+268.801787717" Jul 29 10:24:41.862424 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:41.862368 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d8lzt" podStartSLOduration=1.8623461350000001 podStartE2EDuration="1.862346135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:24:41.860629927 +0000 UTC m=+268.822560536" watchObservedRunningTime="2026-07-29 10:24:41.862346135 +0000 UTC m=+268.824276744" Jul 29 10:24:47.817086 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:47.817054 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sth67" Jul 29 10:24:49.144197 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.144161 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4g8mc"] Jul 29 10:24:49.148863 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.148843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.151301 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.151282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jm55w\"" Jul 29 10:24:49.157236 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.157217 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4g8mc"] Jul 29 10:24:49.260836 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.260802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvblf\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-kube-api-access-qvblf\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.260836 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.260840 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.362189 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.362158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvblf\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-kube-api-access-qvblf\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.362189 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.362200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.371818 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.371787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvblf\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-kube-api-access-qvblf\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.371943 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.371903 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb77ef1d-3f1e-4d36-b8bb-42c469b7696e-bound-sa-token\") pod \"cert-manager-55b4d954d5-4g8mc\" (UID: \"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e\") " pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.458218 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.458136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4g8mc" Jul 29 10:24:49.583447 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.583425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4g8mc"] Jul 29 10:24:49.585742 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:49.585701 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb77ef1d_3f1e_4d36_b8bb_42c469b7696e.slice/crio-62a38ec7e7db38e9bc8e82479e0d9cc8cb2252be28ee5e705d0fffe1a1e43e87 WatchSource:0}: Error finding container 62a38ec7e7db38e9bc8e82479e0d9cc8cb2252be28ee5e705d0fffe1a1e43e87: Status 404 returned error can't find the container with id 62a38ec7e7db38e9bc8e82479e0d9cc8cb2252be28ee5e705d0fffe1a1e43e87 Jul 29 10:24:49.848556 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.848521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4g8mc" event={"ID":"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e","Type":"ContainerStarted","Data":"3d95c5907b53d1b2fba4eac10b4dc01205a701b241119ac4373c3d4c2a1fabf7"} Jul 29 10:24:49.848556 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:49.848558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4g8mc" event={"ID":"fb77ef1d-3f1e-4d36-b8bb-42c469b7696e","Type":"ContainerStarted","Data":"62a38ec7e7db38e9bc8e82479e0d9cc8cb2252be28ee5e705d0fffe1a1e43e87"} Jul 29 10:24:50.980777 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.980726 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4g8mc" podStartSLOduration=1.980710529 podStartE2EDuration="1.980710529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:24:49.865619761 +0000 UTC m=+276.827550370" watchObservedRunningTime="2026-07-29 10:24:50.980710529 +0000 UTC m=+277.942641136" Jul 29 10:24:50.982304 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.982280 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm"] Jul 29 10:24:50.984733 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.984714 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:50.987438 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.987403 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 10:24:50.987520 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.987427 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-cbrj5\"" Jul 29 10:24:50.987574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.987428 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 10:24:50.994289 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:50.994266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm"] Jul 29 10:24:51.078240 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.078195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.078419 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.078271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.078419 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.078301 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57qfk\" (UniqueName: \"kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.179214 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.179158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.179382 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.179231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57qfk\" (UniqueName: \"kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.179382 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.179308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.179591 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.179574 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.179660 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.179600 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.188322 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.188299 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57qfk\" (UniqueName: \"kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.295137 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.295049 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:51.425604 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.425576 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm"] Jul 29 10:24:51.427944 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:24:51.427914 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268efb32_a92c_45b5_a358_5f002bb5e0ff.slice/crio-e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4 WatchSource:0}: Error finding container e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4: Status 404 returned error can't find the container with id e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4 Jul 29 10:24:51.858108 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.858080 2558 generic.go:356] "Generic (PLEG): container finished" podID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerID="deb06331d12baec27f2c18e74bb2c8329bbf8e00031b8be46b852e741f23f12c" exitCode=0 Jul 29 10:24:51.858289 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.858173 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" event={"ID":"268efb32-a92c-45b5-a358-5f002bb5e0ff","Type":"ContainerDied","Data":"deb06331d12baec27f2c18e74bb2c8329bbf8e00031b8be46b852e741f23f12c"} Jul 29 10:24:51.858289 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:51.858230 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" event={"ID":"268efb32-a92c-45b5-a358-5f002bb5e0ff","Type":"ContainerStarted","Data":"e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4"} Jul 29 10:24:54.876414 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:54.876380 2558 generic.go:356] "Generic (PLEG): container finished" podID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerID="e59771c048758c370efd80a650ad7e5b402999561da218647a7290352c5fbe1c" exitCode=0 Jul 29 10:24:54.876781 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:54.876468 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" event={"ID":"268efb32-a92c-45b5-a358-5f002bb5e0ff","Type":"ContainerDied","Data":"e59771c048758c370efd80a650ad7e5b402999561da218647a7290352c5fbe1c"} Jul 29 10:24:55.882548 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:55.882514 2558 generic.go:356] "Generic (PLEG): container finished" podID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerID="480909d48cf658ffdc5ddf05c7552dbfe704fafb81c298675f4a2d24589ed8a4" exitCode=0 Jul 29 10:24:55.883103 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:55.882577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" event={"ID":"268efb32-a92c-45b5-a358-5f002bb5e0ff","Type":"ContainerDied","Data":"480909d48cf658ffdc5ddf05c7552dbfe704fafb81c298675f4a2d24589ed8a4"} Jul 29 10:24:57.019735 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.019712 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:24:57.131122 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.131091 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle\") pod \"268efb32-a92c-45b5-a358-5f002bb5e0ff\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " Jul 29 10:24:57.131282 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.131141 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util\") pod \"268efb32-a92c-45b5-a358-5f002bb5e0ff\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " Jul 29 10:24:57.131282 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.131203 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57qfk\" (UniqueName: \"kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk\") pod \"268efb32-a92c-45b5-a358-5f002bb5e0ff\" (UID: \"268efb32-a92c-45b5-a358-5f002bb5e0ff\") " Jul 29 10:24:57.131503 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.131469 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle" (OuterVolumeSpecName: "bundle") pod "268efb32-a92c-45b5-a358-5f002bb5e0ff" (UID: "268efb32-a92c-45b5-a358-5f002bb5e0ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:24:57.133235 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.133214 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk" (OuterVolumeSpecName: "kube-api-access-57qfk") pod "268efb32-a92c-45b5-a358-5f002bb5e0ff" (UID: "268efb32-a92c-45b5-a358-5f002bb5e0ff"). InnerVolumeSpecName "kube-api-access-57qfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:24:57.137384 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.137360 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util" (OuterVolumeSpecName: "util") pod "268efb32-a92c-45b5-a358-5f002bb5e0ff" (UID: "268efb32-a92c-45b5-a358-5f002bb5e0ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:24:57.232820 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.232786 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:57.232820 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.232814 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/268efb32-a92c-45b5-a358-5f002bb5e0ff-util\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:57.232820 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.232825 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57qfk\" (UniqueName: \"kubernetes.io/projected/268efb32-a92c-45b5-a358-5f002bb5e0ff-kube-api-access-57qfk\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:24:57.893946 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.893841 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" event={"ID":"268efb32-a92c-45b5-a358-5f002bb5e0ff","Type":"ContainerDied","Data":"e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4"} Jul 29 10:24:57.893946 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.893916 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e75d8f614bbd6bebe3e6879fd552078767f7c7fe95dbb51ad538da8fb48759b4" Jul 29 10:24:57.893946 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:24:57.893850 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ebgpsm" Jul 29 10:25:13.462163 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:13.462139 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 10:25:21.612321 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612289 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz"] Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612600 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="pull" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612611 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="pull" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612622 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="extract" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612628 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="extract" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612637 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="util" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612643 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="util" Jul 29 10:25:21.614060 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.612692 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="268efb32-a92c-45b5-a358-5f002bb5e0ff" containerName="extract" Jul 29 10:25:21.614701 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.614688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.617804 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.617785 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 29 10:25:21.618680 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.618662 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 29 10:25:21.618768 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.618693 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Jul 29 10:25:21.618768 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.618668 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Jul 29 10:25:21.619037 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.619017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-vv9rt\"" Jul 29 10:25:21.619037 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.619027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Jul 29 10:25:21.625179 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.625156 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz"] Jul 29 10:25:21.744002 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.743964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-cert\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.744186 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.744027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-metrics-certs\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.744186 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.744125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmd95\" (UniqueName: \"kubernetes.io/projected/8a4f6468-a0ae-4268-a7ea-a9c86e306732-kube-api-access-zmd95\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.744186 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.744173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a4f6468-a0ae-4268-a7ea-a9c86e306732-manager-config\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.845201 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.845168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmd95\" (UniqueName: \"kubernetes.io/projected/8a4f6468-a0ae-4268-a7ea-a9c86e306732-kube-api-access-zmd95\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.845201 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.845204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a4f6468-a0ae-4268-a7ea-a9c86e306732-manager-config\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.845446 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.845254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-cert\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.845446 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.845278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-metrics-certs\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.845991 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.845969 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a4f6468-a0ae-4268-a7ea-a9c86e306732-manager-config\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.848166 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.848146 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-metrics-certs\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.848337 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.848315 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a4f6468-a0ae-4268-a7ea-a9c86e306732-cert\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.855717 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.855696 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmd95\" (UniqueName: \"kubernetes.io/projected/8a4f6468-a0ae-4268-a7ea-a9c86e306732-kube-api-access-zmd95\") pod \"jobset-controller-manager-8769c5cb6-rjnkz\" (UID: \"8a4f6468-a0ae-4268-a7ea-a9c86e306732\") " pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:21.924920 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:21.924804 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:22.060280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:22.060254 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz"] Jul 29 10:25:22.062652 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:25:22.062628 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a4f6468_a0ae_4268_a7ea_a9c86e306732.slice/crio-15690d481f1f846671d82dac9abfc5d4ac601388cf21a96e333ef6dfb4661822 WatchSource:0}: Error finding container 15690d481f1f846671d82dac9abfc5d4ac601388cf21a96e333ef6dfb4661822: Status 404 returned error can't find the container with id 15690d481f1f846671d82dac9abfc5d4ac601388cf21a96e333ef6dfb4661822 Jul 29 10:25:22.064495 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:22.064479 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 10:25:23.005642 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:23.005607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" event={"ID":"8a4f6468-a0ae-4268-a7ea-a9c86e306732","Type":"ContainerStarted","Data":"15690d481f1f846671d82dac9abfc5d4ac601388cf21a96e333ef6dfb4661822"} Jul 29 10:25:25.019210 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:25.019172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" event={"ID":"8a4f6468-a0ae-4268-a7ea-a9c86e306732","Type":"ContainerStarted","Data":"9ce6a7db5738d47c75e65294e1e6cc71634611b20b613cf182e13fff0e0a0864"} Jul 29 10:25:25.019655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:25.019305 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:25:25.039215 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:25.039168 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" podStartSLOduration=1.224318233 podStartE2EDuration="4.039154699s" totalImagesPullingTime="2.814836466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:25:25.037009082 +0000 UTC m=+311.998939700" watchObservedRunningTime="2026-07-29 10:25:25.039154699 +0000 UTC m=+312.001085322" Jul 29 10:25:36.029142 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:25:36.029113 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-8769c5cb6-rjnkz" Jul 29 10:26:15.785170 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.785087 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:26:15.787281 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.787265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.789972 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.789954 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 29 10:26:15.790254 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.790232 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-s5lgs\"" Jul 29 10:26:15.790371 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.790349 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 29 10:26:15.799017 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.798997 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:26:15.810674 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.810646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd5k2\" (UniqueName: \"kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.810817 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.810693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.810817 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.810792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.911608 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.911567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.911813 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.911628 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.911813 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.911672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd5k2\" (UniqueName: \"kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.912069 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.912047 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.912137 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.912099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:15.921547 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:15.921521 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd5k2\" (UniqueName: \"kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2\") pod \"trainer-operator-controller-manager-56f5b7fd56-946n5\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:16.097768 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:16.097735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:16.224904 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:16.224841 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:26:16.226998 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:26:16.226971 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6840ba_712d_49b1_944e_01943498430d.slice/crio-c7e543da7f62ead3fa016f1cb4538fa2b6a8b0239db88528e3067beb9ea7ba46 WatchSource:0}: Error finding container c7e543da7f62ead3fa016f1cb4538fa2b6a8b0239db88528e3067beb9ea7ba46: Status 404 returned error can't find the container with id c7e543da7f62ead3fa016f1cb4538fa2b6a8b0239db88528e3067beb9ea7ba46 Jul 29 10:26:16.250085 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:16.250063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" event={"ID":"ed6840ba-712d-49b1-944e-01943498430d","Type":"ContainerStarted","Data":"c7e543da7f62ead3fa016f1cb4538fa2b6a8b0239db88528e3067beb9ea7ba46"} Jul 29 10:26:19.265308 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:19.265273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" event={"ID":"ed6840ba-712d-49b1-944e-01943498430d","Type":"ContainerStarted","Data":"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a"} Jul 29 10:26:19.265711 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:19.265398 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:26:19.283784 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:19.283733 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" podStartSLOduration=1.933216345 podStartE2EDuration="4.283717198s" totalImagesPullingTime="2.350500853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:26:19.28303516 +0000 UTC m=+366.244965769" watchObservedRunningTime="2026-07-29 10:26:19.283717198 +0000 UTC m=+366.245647806" Jul 29 10:26:30.272916 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:26:30.272869 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:27:27.465327 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.465293 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz"] Jul 29 10:27:27.469931 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.469913 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.478825 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.478800 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz"] Jul 29 10:27:27.535625 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.535589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-tmp\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.535625 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.535628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cd7t\" (UniqueName: \"kubernetes.io/projected/99c5756e-d30c-4354-a0d9-125b57264ec7-kube-api-access-8cd7t\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.535865 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.535720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-manifests-work\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.636470 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.636439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-tmp\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.636470 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.636468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cd7t\" (UniqueName: \"kubernetes.io/projected/99c5756e-d30c-4354-a0d9-125b57264ec7-kube-api-access-8cd7t\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.636728 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.636532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-manifests-work\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.636863 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.636843 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-tmp\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.636929 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.636873 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/99c5756e-d30c-4354-a0d9-125b57264ec7-manifests-work\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.646326 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.646306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cd7t\" (UniqueName: \"kubernetes.io/projected/99c5756e-d30c-4354-a0d9-125b57264ec7-kube-api-access-8cd7t\") pod \"trainer-operator-controller-manager-765484c7d7-9snxz\" (UID: \"99c5756e-d30c-4354-a0d9-125b57264ec7\") " pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.780421 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.780330 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:27.908596 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:27.908574 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz"] Jul 29 10:27:27.910681 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:27:27.910653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c5756e_d30c_4354_a0d9_125b57264ec7.slice/crio-5005c1a8c8b82cc1f34435ac90fdfcd346faa4edf5d56a448b18e2d7197227f3 WatchSource:0}: Error finding container 5005c1a8c8b82cc1f34435ac90fdfcd346faa4edf5d56a448b18e2d7197227f3: Status 404 returned error can't find the container with id 5005c1a8c8b82cc1f34435ac90fdfcd346faa4edf5d56a448b18e2d7197227f3 Jul 29 10:27:28.578999 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:28.578965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" event={"ID":"99c5756e-d30c-4354-a0d9-125b57264ec7","Type":"ContainerStarted","Data":"5005c1a8c8b82cc1f34435ac90fdfcd346faa4edf5d56a448b18e2d7197227f3"} Jul 29 10:27:30.589446 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:30.589412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" event={"ID":"99c5756e-d30c-4354-a0d9-125b57264ec7","Type":"ContainerStarted","Data":"4fe21aff7bdafbc4ad17102fc3144a67c75ce30a3cf47eef5347286414980764"} Jul 29 10:27:30.589835 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:30.589543 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:41.596461 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:41.596389 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" Jul 29 10:27:41.613576 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:41.613529 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-765484c7d7-9snxz" podStartSLOduration=12.875457099 podStartE2EDuration="14.613514111s" totalImagesPullingTime="1.738057012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:27:30.611670443 +0000 UTC m=+437.573601051" watchObservedRunningTime="2026-07-29 10:27:41.613514111 +0000 UTC m=+448.575444741" Jul 29 10:27:41.641574 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:41.641542 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:27:41.641809 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:41.641784 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" podUID="ed6840ba-712d-49b1-944e-01943498430d" containerName="manager" containerID="cri-o://86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a" gracePeriod=10 Jul 29 10:27:41.890376 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:41.890350 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:27:42.066163 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.066131 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd5k2\" (UniqueName: \"kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2\") pod \"ed6840ba-712d-49b1-944e-01943498430d\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " Jul 29 10:27:42.066163 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.066166 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work\") pod \"ed6840ba-712d-49b1-944e-01943498430d\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " Jul 29 10:27:42.066401 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.066257 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp\") pod \"ed6840ba-712d-49b1-944e-01943498430d\" (UID: \"ed6840ba-712d-49b1-944e-01943498430d\") " Jul 29 10:27:42.066555 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.066529 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp" (OuterVolumeSpecName: "tmp") pod "ed6840ba-712d-49b1-944e-01943498430d" (UID: "ed6840ba-712d-49b1-944e-01943498430d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:27:42.068267 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.068243 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2" (OuterVolumeSpecName: "kube-api-access-jd5k2") pod "ed6840ba-712d-49b1-944e-01943498430d" (UID: "ed6840ba-712d-49b1-944e-01943498430d"). InnerVolumeSpecName "kube-api-access-jd5k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:27:42.069031 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.069005 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work" (OuterVolumeSpecName: "manifests-work") pod "ed6840ba-712d-49b1-944e-01943498430d" (UID: "ed6840ba-712d-49b1-944e-01943498430d"). InnerVolumeSpecName "manifests-work". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 10:27:42.167579 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.167473 2558 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-tmp\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:27:42.167579 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.167519 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd5k2\" (UniqueName: \"kubernetes.io/projected/ed6840ba-712d-49b1-944e-01943498430d-kube-api-access-jd5k2\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:27:42.167579 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.167531 2558 reconciler_common.go:299] "Volume detached for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/ed6840ba-712d-49b1-944e-01943498430d-manifests-work\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:27:42.641181 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.641147 2558 generic.go:356] "Generic (PLEG): container finished" podID="ed6840ba-712d-49b1-944e-01943498430d" containerID="86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a" exitCode=0 Jul 29 10:27:42.641650 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.641194 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" Jul 29 10:27:42.641650 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.641233 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" event={"ID":"ed6840ba-712d-49b1-944e-01943498430d","Type":"ContainerDied","Data":"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a"} Jul 29 10:27:42.641650 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.641287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5" event={"ID":"ed6840ba-712d-49b1-944e-01943498430d","Type":"ContainerDied","Data":"c7e543da7f62ead3fa016f1cb4538fa2b6a8b0239db88528e3067beb9ea7ba46"} Jul 29 10:27:42.641650 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.641312 2558 scope.go:117] "RemoveContainer" containerID="86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a" Jul 29 10:27:42.651605 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.651587 2558 scope.go:117] "RemoveContainer" containerID="86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a" Jul 29 10:27:42.651905 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:27:42.651869 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a\": container with ID starting with 86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a not found: ID does not exist" containerID="86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a" Jul 29 10:27:42.651996 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.651912 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a"} err="failed to get container status \"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a\": rpc error: code = NotFound desc = could not find container \"86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a\": container with ID starting with 86eea136a69233b054c3c4a4b8ba9a7c235e905849ed4ec8f847758ca5944d3a not found: ID does not exist" Jul 29 10:27:42.665519 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.665488 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:27:42.667865 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:42.667843 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-56f5b7fd56-946n5"] Jul 29 10:27:43.572493 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:43.572461 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6840ba-712d-49b1-944e-01943498430d" path="/var/lib/kubelet/pods/ed6840ba-712d-49b1-944e-01943498430d/volumes" Jul 29 10:27:53.979537 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.979502 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d54c755f-lcbn4"] Jul 29 10:27:53.979922 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.979849 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed6840ba-712d-49b1-944e-01943498430d" containerName="manager" Jul 29 10:27:53.979922 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.979862 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6840ba-712d-49b1-944e-01943498430d" containerName="manager" Jul 29 10:27:53.979998 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.979938 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed6840ba-712d-49b1-944e-01943498430d" containerName="manager" Jul 29 10:27:53.985445 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.985428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:53.995189 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:53.995163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d54c755f-lcbn4"] Jul 29 10:27:54.066667 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-oauth-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066667 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5gz2\" (UniqueName: \"kubernetes.io/projected/99fbaece-2501-46ef-a0bd-4291d58d91bf-kube-api-access-b5gz2\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-trusted-ca-bundle\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-oauth-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.066864 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.066855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-service-ca\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.167850 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.167850 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-trusted-ca-bundle\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168091 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-oauth-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168091 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-service-ca\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168091 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-oauth-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168091 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167956 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5gz2\" (UniqueName: \"kubernetes.io/projected/99fbaece-2501-46ef-a0bd-4291d58d91bf-kube-api-access-b5gz2\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168091 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.167981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168655 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.168631 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168834 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.168809 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-oauth-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.168905 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.168838 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-service-ca\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.169557 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.169532 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99fbaece-2501-46ef-a0bd-4291d58d91bf-trusted-ca-bundle\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.170284 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.170262 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-oauth-config\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.170420 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.170406 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99fbaece-2501-46ef-a0bd-4291d58d91bf-console-serving-cert\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.177501 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.177480 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5gz2\" (UniqueName: \"kubernetes.io/projected/99fbaece-2501-46ef-a0bd-4291d58d91bf-kube-api-access-b5gz2\") pod \"console-7d54c755f-lcbn4\" (UID: \"99fbaece-2501-46ef-a0bd-4291d58d91bf\") " pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.294232 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.294137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:27:54.424244 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.424222 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d54c755f-lcbn4"] Jul 29 10:27:54.426236 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:27:54.426211 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99fbaece_2501_46ef_a0bd_4291d58d91bf.slice/crio-0fbea034b2b044075236c4e40851403caf359a27225f8d83de6ce3152ad86b26 WatchSource:0}: Error finding container 0fbea034b2b044075236c4e40851403caf359a27225f8d83de6ce3152ad86b26: Status 404 returned error can't find the container with id 0fbea034b2b044075236c4e40851403caf359a27225f8d83de6ce3152ad86b26 Jul 29 10:27:54.698106 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.698069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54c755f-lcbn4" event={"ID":"99fbaece-2501-46ef-a0bd-4291d58d91bf","Type":"ContainerStarted","Data":"cf999899d4ca725b872f3a07b380594c6069d968f78af3ba4cb777832e41dc63"} Jul 29 10:27:54.698305 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.698122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d54c755f-lcbn4" event={"ID":"99fbaece-2501-46ef-a0bd-4291d58d91bf","Type":"ContainerStarted","Data":"0fbea034b2b044075236c4e40851403caf359a27225f8d83de6ce3152ad86b26"} Jul 29 10:27:54.718811 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:27:54.718766 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d54c755f-lcbn4" podStartSLOduration=1.718752592 podStartE2EDuration="1.718752592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 10:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:27:54.717433448 +0000 UTC m=+461.679364054" watchObservedRunningTime="2026-07-29 10:27:54.718752592 +0000 UTC m=+461.680683200" Jul 29 10:28:04.294411 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:04.294380 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:28:04.294908 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:04.294681 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:28:04.298792 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:04.298775 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:28:04.751649 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:04.751622 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d54c755f-lcbn4" Jul 29 10:28:04.812678 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:04.812646 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:28:29.831656 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:29.831613 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b656bd9c6-rthsg" podUID="4634e803-0173-43d4-a088-f83631f23c1a" containerName="console" containerID="cri-o://83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44" gracePeriod=15 Jul 29 10:28:30.082097 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.082043 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:28:30.190843 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.190814 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191023 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.190914 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191023 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.190936 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jjh8\" (UniqueName: \"kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191023 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.190951 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191174 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191124 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191228 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191193 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191279 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191215 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:28:30.191279 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191230 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca\") pod \"4634e803-0173-43d4-a088-f83631f23c1a\" (UID: \"4634e803-0173-43d4-a088-f83631f23c1a\") " Jul 29 10:28:30.191375 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191353 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:28:30.191490 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191467 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config" (OuterVolumeSpecName: "console-config") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:28:30.191569 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191553 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-trusted-ca-bundle\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.191618 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191575 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-oauth-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.191618 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191591 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-console-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.191694 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.191624 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 10:28:30.193120 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.193092 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:28:30.193222 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.193135 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 10:28:30.193222 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.193181 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8" (OuterVolumeSpecName: "kube-api-access-5jjh8") pod "4634e803-0173-43d4-a088-f83631f23c1a" (UID: "4634e803-0173-43d4-a088-f83631f23c1a"). InnerVolumeSpecName "kube-api-access-5jjh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 10:28:30.292713 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.292686 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-serving-cert\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.292713 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.292708 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jjh8\" (UniqueName: \"kubernetes.io/projected/4634e803-0173-43d4-a088-f83631f23c1a-kube-api-access-5jjh8\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.292713 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.292717 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4634e803-0173-43d4-a088-f83631f23c1a-console-oauth-config\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.292942 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.292728 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4634e803-0173-43d4-a088-f83631f23c1a-service-ca\") on node \"ip-10-0-128-91.ec2.internal\" DevicePath \"\"" Jul 29 10:28:30.867760 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.867720 2558 generic.go:356] "Generic (PLEG): container finished" podID="4634e803-0173-43d4-a088-f83631f23c1a" containerID="83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44" exitCode=0 Jul 29 10:28:30.868260 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.867774 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b656bd9c6-rthsg" Jul 29 10:28:30.868260 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.867781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b656bd9c6-rthsg" event={"ID":"4634e803-0173-43d4-a088-f83631f23c1a","Type":"ContainerDied","Data":"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44"} Jul 29 10:28:30.868260 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.867826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b656bd9c6-rthsg" event={"ID":"4634e803-0173-43d4-a088-f83631f23c1a","Type":"ContainerDied","Data":"8a06cc25ab621333f9efef04e0612c56dfa6b5f83bf04407b3b6067e20701b1c"} Jul 29 10:28:30.868260 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.867846 2558 scope.go:117] "RemoveContainer" containerID="83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44" Jul 29 10:28:30.876455 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.876437 2558 scope.go:117] "RemoveContainer" containerID="83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44" Jul 29 10:28:30.876688 ip-10-0-128-91 kubenswrapper[2558]: E0729 10:28:30.876668 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44\": container with ID starting with 83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44 not found: ID does not exist" containerID="83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44" Jul 29 10:28:30.876750 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.876697 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44"} err="failed to get container status \"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44\": rpc error: code = NotFound desc = could not find container \"83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44\": container with ID starting with 83fc43dee1946d5ab49b9aefbfae3d1e2e2dce2d581af9f68514354f28dced44 not found: ID does not exist" Jul 29 10:28:30.890649 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.890625 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:28:30.897601 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:30.897578 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b656bd9c6-rthsg"] Jul 29 10:28:31.572414 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:31.572383 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4634e803-0173-43d4-a088-f83631f23c1a" path="/var/lib/kubelet/pods/4634e803-0173-43d4-a088-f83631f23c1a/volumes" Jul 29 10:28:40.537335 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:40.537306 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f6lcd_c6c9065c-0112-490a-876a-2ad60639d743/global-pull-secret-syncer/0.log" Jul 29 10:28:40.725198 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:40.725171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qmxrv_6dabb725-7bca-4cc7-bbb1-255b95c820c9/konnectivity-agent/0.log" Jul 29 10:28:40.748007 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:40.747984 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-91.ec2.internal_e077154bb05e2b438a55ffc9093c1eb7/haproxy/0.log" Jul 29 10:28:44.738328 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.738300 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/alertmanager/0.log" Jul 29 10:28:44.773822 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.773797 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/config-reloader/0.log" Jul 29 10:28:44.802417 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.802395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/kube-rbac-proxy-web/0.log" Jul 29 10:28:44.827791 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.827771 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/kube-rbac-proxy/0.log" Jul 29 10:28:44.854845 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.854821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/kube-rbac-proxy-metric/0.log" Jul 29 10:28:44.888445 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.888425 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/prom-label-proxy/0.log" Jul 29 10:28:44.918998 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:44.918973 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1dd62950-01a5-4f39-bb39-e7cc94887e34/init-config-reloader/0.log" Jul 29 10:28:45.090226 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.090201 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f7bd46b5-cxbq4_94f70e70-39c3-4773-a18b-8010bbbc86fc/metrics-server/0.log" Jul 29 10:28:45.254173 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.254148 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c65sq_5ee808d2-e7bd-4191-bb51-7411f7fcb2dc/node-exporter/0.log" Jul 29 10:28:45.277671 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.277650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c65sq_5ee808d2-e7bd-4191-bb51-7411f7fcb2dc/kube-rbac-proxy/0.log" Jul 29 10:28:45.306102 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.306084 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c65sq_5ee808d2-e7bd-4191-bb51-7411f7fcb2dc/init-textfile/0.log" Jul 29 10:28:45.424336 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.424266 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gxmx9_107d8279-51e7-450b-a3bf-fa2e840e8bfe/kube-rbac-proxy-main/0.log" Jul 29 10:28:45.454254 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.454231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gxmx9_107d8279-51e7-450b-a3bf-fa2e840e8bfe/kube-rbac-proxy-self/0.log" Jul 29 10:28:45.481213 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.481189 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-gxmx9_107d8279-51e7-450b-a3bf-fa2e840e8bfe/openshift-state-metrics/0.log" Jul 29 10:28:45.737007 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.736928 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-d6l6t_26561384-e4e9-4bb1-b6fc-a64158d4958c/prometheus-operator/0.log" Jul 29 10:28:45.765011 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.764976 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-d6l6t_26561384-e4e9-4bb1-b6fc-a64158d4958c/kube-rbac-proxy/0.log" Jul 29 10:28:45.851517 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.851491 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b968d5bff-km64q_313acaab-f859-4743-b72e-b6aafd78e4a7/telemeter-client/0.log" Jul 29 10:28:45.882911 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.882871 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b968d5bff-km64q_313acaab-f859-4743-b72e-b6aafd78e4a7/reload/0.log" Jul 29 10:28:45.911418 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.911400 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b968d5bff-km64q_313acaab-f859-4743-b72e-b6aafd78e4a7/kube-rbac-proxy/0.log" Jul 29 10:28:45.952415 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.952396 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/thanos-query/0.log" Jul 29 10:28:45.981160 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:45.981141 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/kube-rbac-proxy-web/0.log" Jul 29 10:28:46.010243 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:46.010171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/kube-rbac-proxy/0.log" Jul 29 10:28:46.039064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:46.039038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/prom-label-proxy/0.log" Jul 29 10:28:46.063690 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:46.063668 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/kube-rbac-proxy-rules/0.log" Jul 29 10:28:46.089594 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:46.089572 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546bc96f-vcdr6_40a34658-9215-4253-b0e1-5727e0651a3d/kube-rbac-proxy-metrics/0.log" Jul 29 10:28:48.127647 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.127621 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d54c755f-lcbn4_99fbaece-2501-46ef-a0bd-4291d58d91bf/console/0.log" Jul 29 10:28:48.137997 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.137974 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh"] Jul 29 10:28:48.138292 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.138280 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4634e803-0173-43d4-a088-f83631f23c1a" containerName="console" Jul 29 10:28:48.138292 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.138292 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4634e803-0173-43d4-a088-f83631f23c1a" containerName="console" Jul 29 10:28:48.138405 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.138365 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4634e803-0173-43d4-a088-f83631f23c1a" containerName="console" Jul 29 10:28:48.141261 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.141246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.144077 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.144061 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fpcwg\"/\"default-dockercfg-7pvp7\"" Jul 29 10:28:48.144318 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.144304 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fpcwg\"/\"openshift-service-ca.crt\"" Jul 29 10:28:48.145133 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.145104 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fpcwg\"/\"kube-root-ca.crt\"" Jul 29 10:28:48.150457 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.150435 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh"] Jul 29 10:28:48.169806 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.169782 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-prdfr_6a919ea5-d219-45ac-80ca-268ab3c4e8de/download-server/0.log" Jul 29 10:28:48.253250 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.253223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-lib-modules\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.253250 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.253253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-proc\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.253422 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.253288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-podres\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.253422 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.253319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzck\" (UniqueName: \"kubernetes.io/projected/886f4c02-f794-4e6c-8635-2727e28ca550-kube-api-access-fpzck\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.253422 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.253345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-sys\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353752 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-lib-modules\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353752 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-proc\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-podres\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353863 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-proc\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353901 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-podres\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353920 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-lib-modules\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.353986 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzck\" (UniqueName: \"kubernetes.io/projected/886f4c02-f794-4e6c-8635-2727e28ca550-kube-api-access-fpzck\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.354223 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.354037 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-sys\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.354223 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.353994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/886f4c02-f794-4e6c-8635-2727e28ca550-sys\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.363274 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.363246 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzck\" (UniqueName: \"kubernetes.io/projected/886f4c02-f794-4e6c-8635-2727e28ca550-kube-api-access-fpzck\") pod \"perf-node-gather-daemonset-gxqgh\" (UID: \"886f4c02-f794-4e6c-8635-2727e28ca550\") " pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.451426 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.451352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.578137 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.578047 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh"] Jul 29 10:28:48.580377 ip-10-0-128-91 kubenswrapper[2558]: W0729 10:28:48.580352 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod886f4c02_f794_4e6c_8635_2727e28ca550.slice/crio-ec5148f5e02c9d8c39a83915958b340976bdc5bb77322b97af06ee08cace6689 WatchSource:0}: Error finding container ec5148f5e02c9d8c39a83915958b340976bdc5bb77322b97af06ee08cace6689: Status 404 returned error can't find the container with id ec5148f5e02c9d8c39a83915958b340976bdc5bb77322b97af06ee08cace6689 Jul 29 10:28:48.948890 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.948838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" event={"ID":"886f4c02-f794-4e6c-8635-2727e28ca550","Type":"ContainerStarted","Data":"d26aaeb1e130e4fb0c1eff92bb74ba9e9afbf7b249ee5ebd706c70f596cf7cd7"} Jul 29 10:28:48.949065 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.948914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" event={"ID":"886f4c02-f794-4e6c-8635-2727e28ca550","Type":"ContainerStarted","Data":"ec5148f5e02c9d8c39a83915958b340976bdc5bb77322b97af06ee08cace6689"} Jul 29 10:28:48.949065 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.948943 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:48.966548 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:48.966460 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" podStartSLOduration=0.966447565 podStartE2EDuration="966.447565ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 10:28:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 10:28:48.964928172 +0000 UTC m=+515.926858781" watchObservedRunningTime="2026-07-29 10:28:48.966447565 +0000 UTC m=+515.928378195" Jul 29 10:28:49.562156 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:49.562127 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cnp2s_649878a0-5049-4eaf-8317-2eec67e6dd2a/dns/0.log" Jul 29 10:28:49.586640 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:49.586620 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cnp2s_649878a0-5049-4eaf-8317-2eec67e6dd2a/kube-rbac-proxy/0.log" Jul 29 10:28:49.745964 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:49.745937 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkppp_af893ee0-5ee0-4dd8-92de-815dd0a3bd96/dns-node-resolver/0.log" Jul 29 10:28:50.281556 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:50.281522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rwxhg_29664a2f-cbb6-421a-abd1-1700a502dcd8/node-ca/0.log" Jul 29 10:28:51.400395 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:51.400367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smr9q_adda7f6f-91bf-4275-b61c-2a562c553e7b/serve-healthcheck-canary/0.log" Jul 29 10:28:51.823836 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:51.823812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4pfwd_a5c4008b-27e2-452f-a05f-244681f5733d/kube-rbac-proxy/0.log" Jul 29 10:28:51.848799 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:51.848777 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4pfwd_a5c4008b-27e2-452f-a05f-244681f5733d/exporter/0.log" Jul 29 10:28:51.871670 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:51.871647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4pfwd_a5c4008b-27e2-452f-a05f-244681f5733d/extractor/0.log" Jul 29 10:28:53.657244 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:53.657193 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-8769c5cb6-rjnkz_8a4f6468-a0ae-4268-a7ea-a9c86e306732/manager/0.log" Jul 29 10:28:54.963064 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:54.963038 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fpcwg/perf-node-gather-daemonset-gxqgh" Jul 29 10:28:58.622257 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.622231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/kube-multus-additional-cni-plugins/0.log" Jul 29 10:28:58.647063 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.647038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/egress-router-binary-copy/0.log" Jul 29 10:28:58.668925 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.668901 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/cni-plugins/0.log" Jul 29 10:28:58.696154 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.696133 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/bond-cni-plugin/0.log" Jul 29 10:28:58.724988 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.724971 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/routeoverride-cni/0.log" Jul 29 10:28:58.750110 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.750091 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/whereabouts-cni-bincopy/0.log" Jul 29 10:28:58.773561 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:58.773543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mw2j8_bf84ffdf-c678-453a-a765-8f167b90ce68/whereabouts-cni/0.log" Jul 29 10:28:59.026517 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:59.026450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qr2zg_2fc5c9e1-4fb9-4e4c-b79c-83afca1a5a6d/kube-multus/0.log" Jul 29 10:28:59.085019 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:59.084989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-895ll_e12f1c68-731d-430c-9bf8-d1dd2b2a60d7/network-metrics-daemon/0.log" Jul 29 10:28:59.109393 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:28:59.109369 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-895ll_e12f1c68-731d-430c-9bf8-d1dd2b2a60d7/kube-rbac-proxy/0.log" Jul 29 10:29:00.427633 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.427605 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/ovn-controller/0.log" Jul 29 10:29:00.447716 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.447695 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/ovn-acl-logging/0.log" Jul 29 10:29:00.471980 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.471957 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/kube-rbac-proxy-node/0.log" Jul 29 10:29:00.496952 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.496932 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 10:29:00.522673 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.522649 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/northd/0.log" Jul 29 10:29:00.547956 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.547931 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/nbdb/0.log" Jul 29 10:29:00.573280 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.573265 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/sbdb/0.log" Jul 29 10:29:00.619645 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:00.619623 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-flwzb_9e3994ee-1701-458b-b35d-cc15970abb28/ovnkube-controller/0.log" Jul 29 10:29:01.731833 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:01.731805 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kxwzp_c3b93cfd-370c-4b07-a767-b72be7e3d4ba/network-check-target-container/0.log" Jul 29 10:29:02.725625 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:02.725602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8tjk2_6aa0e7c1-a926-4fc2-9fdc-b3a74adf76ce/iptables-alerter/0.log" Jul 29 10:29:03.552872 ip-10-0-128-91 kubenswrapper[2558]: I0729 10:29:03.552818 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-l2v9k_e3b6bfab-0ef8-4bb6-a6ab-2f854e60e42a/tuned/0.log"