Jul 28 17:59:59.185691 ip-10-0-141-105 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:59:59.609218 ip-10-0-141-105 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:59.609218 ip-10-0-141-105 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:59:59.609218 ip-10-0-141-105 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:59.609218 ip-10-0-141-105 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:59:59.609218 ip-10-0-141-105 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:59:59.611930 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.611836 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:59:59.617268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617244 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617274 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617281 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617288 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617293 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617298 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617303 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617307 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617312 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617316 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617320 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617325 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617329 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617333 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617337 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617341 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617345 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617349 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617354 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.617348 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617359 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617363 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617367 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617387 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617392 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617396 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617400 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617404 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617409 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617425 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617429 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617433 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617437 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617441 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617446 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617450 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617454 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617458 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617463 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617467 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.618124 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617472 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617476 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617481 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617485 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617489 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617493 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617497 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617501 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617506 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617510 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617514 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617518 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617524 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617528 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617537 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617541 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617546 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617550 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617557 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.619009 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617564 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617569 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617576 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617583 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617587 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617593 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617597 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617602 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617606 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617611 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617615 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617620 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617626 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617631 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617635 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617639 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617644 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617648 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617652 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.619816 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617656 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617661 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617665 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617670 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617674 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617679 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617683 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617688 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617694 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617698 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617702 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617707 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617711 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617716 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617720 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617724 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617728 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617736 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617740 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617744 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.620621 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617748 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.617752 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.618985 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.618996 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619001 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619005 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619011 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619015 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619019 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619023 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619026 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619030 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619034 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619039 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619043 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619047 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619052 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619056 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619060 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619064 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.621476 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619069 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619073 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619077 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619084 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619091 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619096 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619101 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619106 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619110 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619114 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619120 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619124 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619128 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619134 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619140 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619145 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619150 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619154 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.622303 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619160 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619164 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619168 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619172 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619176 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619181 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619185 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619189 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619193 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619198 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619202 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619206 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619210 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619215 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619219 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619224 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619228 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619233 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619237 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619241 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.622782 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619245 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619249 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619254 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619258 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619262 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619267 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619271 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619275 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619279 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619284 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619288 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619292 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619296 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619300 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619305 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619312 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619318 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619323 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619327 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619332 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.623354 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619336 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619340 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619344 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619349 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619353 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619357 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619361 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619366 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619370 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619393 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619398 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619402 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619406 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619410 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619415 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619419 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619423 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619428 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619433 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619437 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.624096 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619441 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619445 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.619449 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620177 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620186 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620194 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620199 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620204 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620209 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620213 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620217 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620222 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620226 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620230 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620234 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620238 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620243 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620247 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620254 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.624608 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620258 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620262 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620266 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620270 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620274 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620278 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620283 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620287 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620291 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620296 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620300 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620305 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620309 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620314 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620318 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620322 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620326 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620330 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620337 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620343 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.625102 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620348 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620352 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620356 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620360 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620364 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620369 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620392 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620398 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620402 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620406 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620410 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620417 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620421 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620427 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620433 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620438 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620443 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620447 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620452 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.625691 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620456 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620461 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620465 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620469 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620473 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620480 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620484 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620488 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620492 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620497 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620501 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620505 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620509 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620513 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620518 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620522 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620526 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620530 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620534 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620539 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.626187 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620543 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620547 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620551 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620555 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620562 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620566 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620573 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620577 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620581 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620585 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620590 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620594 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620599 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620603 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620607 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620611 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620615 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620619 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620623 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620628 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.626714 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620632 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620636 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620640 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.620644 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620756 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620776 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620786 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620793 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620800 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620805 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620812 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620819 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620825 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620830 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620835 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620841 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620848 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620853 2561 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620858 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620862 2561 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620867 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620871 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620878 2561 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:59:59.627204 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620882 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620887 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620892 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620898 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620904 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620909 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620914 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620920 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620926 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620931 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620936 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620941 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620946 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620952 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620957 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620962 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620966 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620971 2561 flags.go:64] FLAG: --enable-server="true" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620977 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620989 2561 flags.go:64] FLAG: --event-burst="100" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620994 2561 flags.go:64] FLAG: --event-qps="50" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.620998 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621003 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621008 2561 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:59:59.627811 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621014 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621021 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621026 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621031 2561 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621035 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621040 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621044 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621050 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621054 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621059 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621064 2561 flags.go:64] FLAG: --feature-gates="" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621070 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621075 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621080 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621085 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621090 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621095 2561 flags.go:64] FLAG: --help="false" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621101 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621106 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621111 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621115 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621121 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621126 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621131 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:59:59.628400 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621135 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621140 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621145 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621151 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621156 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621161 2561 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621165 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621170 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621175 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621182 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621187 2561 flags.go:64] FLAG: --lock-file="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621191 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621196 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621201 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621210 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621215 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621220 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621224 2561 flags.go:64] FLAG: --logging-format="text" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621229 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621235 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621240 2561 flags.go:64] FLAG: --manifest-url="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621244 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621251 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621257 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621263 2561 flags.go:64] FLAG: --max-pods="110" Jul 28 17:59:59.629082 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621268 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621278 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621283 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621287 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621292 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621297 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621302 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621313 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621318 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621323 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621329 2561 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621334 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621343 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621348 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621352 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621357 2561 flags.go:64] FLAG: --port="10250" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621362 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621368 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2ec1626c5073ad8" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621391 2561 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621396 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621401 2561 flags.go:64] FLAG: --register-node="true" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621406 2561 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621411 2561 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621416 2561 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:59:59.629724 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621421 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621425 2561 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621432 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621436 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621441 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621446 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621451 2561 flags.go:64] FLAG: --runonce="false" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621455 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621460 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621465 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621471 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621475 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621480 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621485 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621489 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621494 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621498 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621503 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621509 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621514 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621519 2561 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621524 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621533 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621538 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621543 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:59:59.630424 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621550 2561 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621555 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621560 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621565 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621570 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621574 2561 flags.go:64] FLAG: --v="2" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621581 2561 flags.go:64] FLAG: --version="false" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621587 2561 flags.go:64] FLAG: --vmodule="" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621593 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.621598 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621780 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621787 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621791 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621796 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621800 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621804 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621809 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621813 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621818 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621822 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621826 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621831 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.631365 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621835 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621842 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621847 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621854 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621859 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621864 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621868 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621873 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621877 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621882 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621887 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621892 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621896 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621900 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621904 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621908 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621913 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621917 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621921 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.631965 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621925 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621930 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621934 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621938 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621942 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621946 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621950 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621955 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621959 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621963 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621968 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621972 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621977 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621981 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621985 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621990 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.621995 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622000 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622004 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622008 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.632556 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622012 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622016 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622020 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622024 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622028 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622032 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622036 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622042 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622048 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622052 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622056 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622060 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622064 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622068 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622072 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622076 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622080 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622085 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622089 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622093 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.633042 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622097 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622101 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622105 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622110 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622114 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622118 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622122 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622127 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622133 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622137 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622141 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622145 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622149 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622156 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622161 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622166 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622170 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622175 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622179 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622184 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.633552 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622188 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622192 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622196 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622200 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622205 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622208 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622212 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.622217 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.622836 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632012 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632031 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632052 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632058 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632117 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632122 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.634041 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632126 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632128 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632131 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632135 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632137 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632140 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632142 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632144 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632147 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632150 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632152 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632155 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632158 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632160 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632163 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632166 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632168 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632171 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632173 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632176 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.634437 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632178 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632181 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632183 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632186 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632190 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632193 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632196 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632199 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632202 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632205 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632208 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632210 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632213 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632215 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632218 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632221 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632223 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632226 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632228 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.634937 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632231 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632233 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632236 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632238 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632240 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632246 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632249 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632252 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632254 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632256 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632259 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632261 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632264 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632266 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632268 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632271 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632273 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632276 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632278 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.635463 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632281 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632284 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632287 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632289 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632293 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632297 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632300 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632303 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632306 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632308 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632311 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632313 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632316 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632318 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632321 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632325 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632328 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632331 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632333 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.635923 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632337 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632339 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632342 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632345 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632348 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632350 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632353 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632356 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632359 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632361 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632364 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632366 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632369 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632387 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632391 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632394 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632396 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632399 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632402 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.636406 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632404 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632410 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632530 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632534 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632537 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632540 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632543 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632545 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632547 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632550 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632552 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632555 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632558 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632560 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632563 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:59:59.636902 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632567 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632571 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632574 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632577 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632580 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632583 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632585 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632588 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632591 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632594 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632596 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632599 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632602 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632605 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632608 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632611 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632614 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632616 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632619 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632621 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:59:59.637268 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632624 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632627 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632631 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632633 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632636 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632638 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632640 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632643 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632645 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632648 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632650 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632653 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632655 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632658 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632660 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632663 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632666 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632668 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632671 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:59:59.637864 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632673 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632675 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632678 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632680 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632682 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632685 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632687 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632690 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632692 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632695 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632697 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632700 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632703 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632705 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632707 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632710 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632712 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632714 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632717 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632719 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:59:59.638319 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632722 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632724 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632726 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632729 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632731 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632734 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632739 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632742 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632745 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632748 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632750 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632753 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632755 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632758 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632761 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632763 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632765 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632768 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632771 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:59:59.638827 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632773 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632776 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632778 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632780 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632783 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632785 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632788 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: W0728 17:59:59.632790 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632795 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.632918 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.635204 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.636740 2561 server.go:1019] "Starting client certificate rotation" Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.636839 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:59:59.639289 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.636884 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:59:59.639634 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.639246 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:59:59.640412 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.640394 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:59:59.653167 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.653145 2561 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:59:59.655562 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.655543 2561 log.go:25] "Validated CRI v1 image API" Jul 28 17:59:59.657175 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.657158 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:59:59.663132 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.663105 2561 fs.go:135] Filesystem UUIDs: map[19a210dc-9f45-4306-8e25-1e5acdf79672:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d7ecf058-5b87-4b13-9169-05c789f7704a:/dev/nvme0n1p3] Jul 28 17:59:59.663209 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.663131 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:59:59.667439 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.667419 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:59:59.669338 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.669222 2561 manager.go:216] Machine: {Timestamp:2026-07-28 17:59:59.666711956 +0000 UTC m=+0.354272630 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094750 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eab67681f57ed7e8894a7cbce3865 SystemUUID:ec2eab67-681f-57ed-7e88-94a7cbce3865 BootID:7b58c6f0-bd29-455c-96a0-585840633ef0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:5c:c8:76:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:5c:c8:76:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:aa:80:ab:af:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:59:59.669338 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.669334 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:59:59.669472 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.669438 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:59:59.673411 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.673385 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:59:59.673556 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.673415 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:59:59.674189 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.674179 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:59:59.674224 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.674192 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:59:59.674224 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.674200 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:59:59.674873 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.674861 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:59:59.675779 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.675768 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:59:59.678903 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.678889 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:59:59.679054 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679044 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:59:59.679102 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679075 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:59:59.679102 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679084 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:59:59.679102 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679098 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:59:59.679211 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679110 2561 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:59:59.679211 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679119 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:59:59.679667 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679629 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:59:59.679667 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.679668 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:59:59.683679 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.683657 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:59:59.685568 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.685554 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:59:59.685629 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.685585 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:59:59.688338 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688326 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688344 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688350 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688355 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688363 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688368 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688393 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688398 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:59:59.688405 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688405 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:59:59.688615 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688411 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:59:59.688615 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688419 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:59:59.688615 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.688424 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:59:59.689189 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.689177 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:59:59.689226 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.689191 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:59:59.691596 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.691569 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:59:59.691664 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.691596 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:59:59.691664 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.691641 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:59:59.692631 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.692618 2561 server.go:1268] "Started kubelet" Jul 28 17:59:59.692764 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.692716 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:59:59.692879 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.692716 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:59:59.692928 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.692891 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:59:59.693732 ip-10-0-141-105 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:59:59.693855 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.693842 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:59:59.697632 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.697614 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:59:59.699224 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.699207 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:59:59.701133 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.699831 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-105.ec2.internal.18c685f758d2907e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-105.ec2.internal,UID:ip-10-0-141-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-105.ec2.internal,},FirstTimestamp:2026-07-28 17:59:59.69259123 +0000 UTC m=+0.380151902,LastTimestamp:2026-07-28 17:59:59.69259123 +0000 UTC m=+0.380151902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-105.ec2.internal,}" Jul 28 17:59:59.705103 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.705083 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:59:59.705103 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.705087 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:59:59.705313 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.705291 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 17:59:59.706130 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706108 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:59:59.706217 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706126 2561 factory.go:153] Registering CRI-O factory Jul 28 17:59:59.706217 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706154 2561 factory.go:223] Registration of the crio container factory successfully Jul 28 17:59:59.706217 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706203 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:59:59.706217 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706211 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:59:59.706217 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706217 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706235 2561 factory.go:55] Registering systemd factory Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706242 2561 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706262 2561 factory.go:103] Registering Raw factory Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706277 2561 manager.go:1196] Started watching for new ooms in manager Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706357 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5mvv" Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706390 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:59:59.706502 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706407 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:59:59.706851 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.706829 2561 manager.go:349] Starting recovery of all containers Jul 28 17:59:59.717517 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.717308 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s5mvv" Jul 28 17:59:59.717888 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.717864 2561 manager.go:354] Recovery completed Jul 28 17:59:59.719654 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.719623 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 17:59:59.720340 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.720311 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:59:59.720444 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.720407 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:59:59.723091 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.723077 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.725743 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.725730 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.725807 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.725756 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.725807 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.725766 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.726328 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.726311 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:59:59.726328 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.726325 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:59:59.726461 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.726343 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:59:59.726461 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.726312 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.728153 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.728138 2561 policy_none.go:49] "None policy: Start" Jul 28 17:59:59.728209 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.728156 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:59:59.728209 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.728168 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:59:59.729384 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.729359 2561 policy_none.go:47] "Start" Jul 28 17:59:59.729536 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.729522 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.729595 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.729555 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.729595 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.729571 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.766007 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.765986 2561 manager.go:337] "Starting Device Plugin manager" Jul 28 17:59:59.766132 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.766039 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:59:59.766132 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766052 2561 server.go:87] "Starting device plugin registration server" Jul 28 17:59:59.766324 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766312 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:59:59.766360 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766327 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:59:59.766443 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766421 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:59:59.766515 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766500 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:59:59.766515 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.766508 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:59:59.767067 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.767045 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:59:59.767175 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.767094 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 17:59:59.843642 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.843603 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:59:59.845035 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.845014 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:59:59.845132 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.845054 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:59:59.845132 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.845084 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:59:59.845223 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.845127 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:59:59.847909 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.847885 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:59:59.867317 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.867253 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.868229 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.868214 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.868293 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.868244 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.868293 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.868256 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.868293 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.868282 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.875326 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.875306 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.875418 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.875330 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-105.ec2.internal\": node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 17:59:59.890178 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.890151 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 17:59:59.945697 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.945664 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal"] Jul 28 17:59:59.945844 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.945769 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.948592 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.948566 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.948592 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.948593 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.948733 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.948603 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.949988 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.949976 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.950116 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.950151 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950123 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.950844 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950826 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.950844 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950848 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.950980 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950877 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.950980 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950886 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.950980 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950917 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.950980 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.950931 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.952248 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.952235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.952295 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.952259 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:59:59.952949 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.952935 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:59:59.953020 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.952958 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:59:59.953020 ip-10-0-141-105 kubenswrapper[2561]: I0728 17:59:59.952967 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:59:59.978095 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.978073 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.982784 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.982767 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-105.ec2.internal\" not found" node="ip-10-0-141-105.ec2.internal" Jul 28 17:59:59.990240 ip-10-0-141-105 kubenswrapper[2561]: E0728 17:59:59.990225 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:00.090357 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:00.090329 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:00.107693 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.107664 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518b8e3a950744810faae7969fae1c45-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"518b8e3a950744810faae7969fae1c45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.107759 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.107697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.107759 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.107725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.191141 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:00.191070 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:00.208425 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.208476 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.208476 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518b8e3a950744810faae7969fae1c45-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"518b8e3a950744810faae7969fae1c45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.208539 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208475 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/518b8e3a950744810faae7969fae1c45-config\") pod \"kube-apiserver-proxy-ip-10-0-141-105.ec2.internal\" (UID: \"518b8e3a950744810faae7969fae1c45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.208539 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208491 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:00.208539 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:00.208505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4420f29174221746d4074a8608b471e6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal\" (UID: \"4420f29174221746d4074a8608b471e6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:01.458107 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.458060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:01.462763 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.462649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 18:00:01.468486 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.468465 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:01.569112 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.569071 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:01.669675 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.669605 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:01.770150 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.770106 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:01.812641 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.812617 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 18:00:01.813128 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.812800 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 18:00:01.870991 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.870966 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:01.900272 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.900232 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:55:00 +0000 UTC" deadline="2028-01-11 20:33:58.918653025 +0000 UTC" Jul 28 18:00:01.900272 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:01.900264 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12770h33m57.018392102s" Jul 28 18:00:01.971607 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:01.971539 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-105.ec2.internal\" not found" Jul 28 18:00:02.025021 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.024992 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:02.048668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.048639 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:02.082691 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.082663 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" Jul 28 18:00:02.095330 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.095305 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 18:00:02.096456 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.096442 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" Jul 28 18:00:02.110428 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.110407 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 18:00:02.110724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.110700 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:02.225502 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:02.225370 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4420f29174221746d4074a8608b471e6.slice/crio-75f750cc1358e42f4c0379bd476f5fb0a8d8db65af885ae34947bfbd90f8aef1 WatchSource:0}: Error finding container 75f750cc1358e42f4c0379bd476f5fb0a8d8db65af885ae34947bfbd90f8aef1: Status 404 returned error can't find the container with id 75f750cc1358e42f4c0379bd476f5fb0a8d8db65af885ae34947bfbd90f8aef1 Jul 28 18:00:02.226198 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:02.226171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518b8e3a950744810faae7969fae1c45.slice/crio-352fd6addfa721c113571ec7dfd0c389b97ef04145ef232868067d4bd37baf24 WatchSource:0}: Error finding container 352fd6addfa721c113571ec7dfd0c389b97ef04145ef232868067d4bd37baf24: Status 404 returned error can't find the container with id 352fd6addfa721c113571ec7dfd0c389b97ef04145ef232868067d4bd37baf24 Jul 28 18:00:02.230838 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.230817 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 18:00:02.856581 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.856544 2561 apiserver.go:52] "Watching apiserver" Jul 28 18:00:02.866021 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.865985 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 18:00:02.866393 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.866362 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-ncqt7","kube-system/global-pull-secret-syncer-j6989","kube-system/konnectivity-agent-frknc","openshift-image-registry/node-ca-bq5t7","openshift-multus/multus-8pb9j","openshift-multus/multus-additional-cni-plugins-cwkwz","openshift-multus/network-metrics-daemon-t46rm","openshift-network-diagnostics/network-check-target-k9bnn","openshift-network-operator/iptables-alerter-ww4jm","kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc","openshift-cluster-node-tuning-operator/tuned-jr45s","openshift-dns/node-resolver-gm9g9"] Jul 28 18:00:02.868848 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.868325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.870500 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.870480 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.871142 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.870957 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rntlr\"" Jul 28 18:00:02.871461 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.871440 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:02.871547 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.871519 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:02.872982 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.872956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:02.875389 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.874732 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.875745 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.875724 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.875745 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.875749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.875921 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.875834 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.875996 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.875987 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 18:00:02.876055 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.875722 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 18:00:02.876055 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876010 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 18:00:02.876277 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876259 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 18:00:02.876346 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 18:00:02.876346 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w9rzt\"" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876933 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.876955 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w2nl9\"" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.877274 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.877662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vmjss\"" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.878461 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:02.878895 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.878517 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:02.879995 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.879625 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.880133 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.880114 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 18:00:02.880230 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.880144 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.880230 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.880191 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.889388 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.889350 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 18:00:02.890081 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.890053 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zdxv6\"" Jul 28 18:00:02.890195 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.890105 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bkvd2\"" Jul 28 18:00:02.891152 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.890515 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.891152 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.890805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.891152 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.891084 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.891152 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.891089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.892892 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.892854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:02.892988 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.892951 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:02.893397 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-serviceca\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.893479 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893479 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-script-lib\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893479 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:02.893479 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-multus\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-multus-daemon-config\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-etc-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-slash\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-modprobe-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysconfig\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-system-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-hostroot\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-ovn\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.893674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxxq5\" (UniqueName: \"kubernetes.io/projected/72f8976b-30cc-4090-9e87-7557a4e44c62-kube-api-access-nxxq5\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-node-log\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-log-socket\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2353c788-59df-444a-a10f-2cb3c7c9f236-ovn-node-metrics-cert\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4k9m\" (UniqueName: \"kubernetes.io/projected/2353c788-59df-444a-a10f-2cb3c7c9f236-kube-api-access-w4k9m\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-conf\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-etc-kubernetes\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-netns\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-host-slash\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-kubelet-config\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-k8s-cni-cncf-io\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-host\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nr5j\" (UniqueName: \"kubernetes.io/projected/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-kube-api-access-6nr5j\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-systemd\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.893994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-var-lib-kubelet\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-tuned\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-hosts-file\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-agent-certs\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-sys\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894165 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-cni-binary-copy\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-os-release\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894217 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-var-lib-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-env-overrides\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-lib-modules\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-netns\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-bin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-tmp-dir\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-systemd-units\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-systemd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894420 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.894798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-netd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-config\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-socket-dir-parent\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-system-cni-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhz9m\" (UniqueName: \"kubernetes.io/projected/e450dd62-d3d7-463e-84cd-d3add06d7f0d-kube-api-access-xhz9m\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-iptables-alerter-script\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9jxc\" (UniqueName: \"kubernetes.io/projected/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-kube-api-access-p9jxc\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894661 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs27c\" (UniqueName: \"kubernetes.io/projected/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-kube-api-access-cs27c\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-konnectivity-ca\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894757 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-kubelet\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-bin\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfvwj\" (UniqueName: \"kubernetes.io/projected/891c882b-1afa-44d2-9519-767eeebe12ed-kube-api-access-hfvwj\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cnibin\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.895523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54dg\" (UniqueName: \"kubernetes.io/projected/b3eed24a-f3ce-4080-804e-a0707e54e551-kube-api-access-l54dg\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-kubernetes\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.894979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-kubelet\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-multus-certs\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-host\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-tmp\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895116 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-dbus\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-cnibin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-run\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-os-release\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895337 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895354 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-conf-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.895591 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 18:00:02.896270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 18:00:02.896886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896282 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 18:00:02.896886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896324 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.896886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896529 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gklpj\"" Jul 28 18:00:02.896886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896682 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.896886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.896697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2m7gf\"" Jul 28 18:00:02.898274 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.898254 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 18:00:02.899598 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.899443 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 18:00:02.899843 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.899824 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8jb5s\"" Jul 28 18:00:02.900471 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.900453 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 18:00:02.911302 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.911016 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 18:00:02.968029 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.968002 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jdcf" Jul 28 18:00:02.975931 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.975900 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8jdcf" Jul 28 18:00:02.984027 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.984006 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 18:00:02.996103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.996103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-device-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvll9\" (UniqueName: \"kubernetes.io/projected/792efb57-c4e2-43d8-9226-64d110a694ec-kube-api-access-lvll9\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-host\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nr5j\" (UniqueName: \"kubernetes.io/projected/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-kube-api-access-6nr5j\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-systemd\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-var-lib-kubelet\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-tuned\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-hosts-file\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.996312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-agent-certs\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-sys\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-cni-binary-copy\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-os-release\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-var-lib-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-env-overrides\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996490 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-lib-modules\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-netns\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-bin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-tmp-dir\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-systemd-units\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-systemd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-netd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-config\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:02.996831 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-socket-dir-parent\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-system-cni-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhz9m\" (UniqueName: \"kubernetes.io/projected/e450dd62-d3d7-463e-84cd-d3add06d7f0d-kube-api-access-xhz9m\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-iptables-alerter-script\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996766 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9jxc\" (UniqueName: \"kubernetes.io/projected/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-kube-api-access-p9jxc\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs27c\" (UniqueName: \"kubernetes.io/projected/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-kube-api-access-cs27c\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-konnectivity-ca\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-kubelet\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-bin\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfvwj\" (UniqueName: \"kubernetes.io/projected/891c882b-1afa-44d2-9519-767eeebe12ed-kube-api-access-hfvwj\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cnibin\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.996978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54dg\" (UniqueName: \"kubernetes.io/projected/b3eed24a-f3ce-4080-804e-a0707e54e551-kube-api-access-l54dg\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-kubernetes\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-kubelet\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:02.997617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-multus-certs\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-host\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997089 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-tmp\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997399 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-env-overrides\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-lib-modules\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-netns\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-dbus\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.997531 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997582 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-kubelet\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-bin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cnibin\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997610 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-os-release\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997632 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-multus-certs\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-host\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-var-lib-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-host\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:03.002778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997846 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-systemd-units\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997904 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-systemd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997949 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-tmp-dir\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.997998 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-sys\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998118 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998172 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-kubernetes\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998230 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-cni-binary-copy\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998248 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-konnectivity-ca\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998408 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-iptables-alerter-script\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998407 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-hosts-file\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998442 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-kubelet\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-var-lib-kubelet\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-config\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-systemd\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998693 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e450dd62-d3d7-463e-84cd-d3add06d7f0d-system-cni-dir\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998724 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-bin\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998851 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.998923 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.003728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-cnibin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-run\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-os-release\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999160 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-dbus\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-conf-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999204 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999255 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-cnibin\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-serviceca\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999294 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-os-release\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-script-lib\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999377 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-socket-dir-parent\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999422 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-multus\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.999458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:03.499438031 +0000 UTC m=+3.010505930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:03.004699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999465 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-var-lib-cni-multus\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999474 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-run\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.999559 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:02.999607 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:03.49959097 +0000 UTC m=+3.010658866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-multus-daemon-config\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999746 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-multus-conf-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-etc-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-slash\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-modprobe-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysconfig\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-system-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:02.999979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2353c788-59df-444a-a10f-2cb3c7c9f236-ovnkube-script-lib\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-hostroot\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-ovn\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.005366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxxq5\" (UniqueName: \"kubernetes.io/projected/72f8976b-30cc-4090-9e87-7557a4e44c62-kube-api-access-nxxq5\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000212 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-serviceca\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-node-log\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-hostroot\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000266 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-node-log\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000297 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000305 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-modprobe-d\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000247 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-slash\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-log-socket\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000335 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-run-ovn\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000357 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000372 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-etc-openvswitch\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-log-socket\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000394 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-cni-netd\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000433 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysconfig\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000476 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-system-cni-dir\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2353c788-59df-444a-a10f-2cb3c7c9f236-ovn-node-metrics-cert\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4k9m\" (UniqueName: \"kubernetes.io/projected/2353c788-59df-444a-a10f-2cb3c7c9f236-kube-api-access-w4k9m\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000777 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/891c882b-1afa-44d2-9519-767eeebe12ed-multus-daemon-config\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000854 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e450dd62-d3d7-463e-84cd-d3add06d7f0d-cni-binary-copy\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-conf\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.000920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-etc-kubernetes\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001010 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-etc-kubernetes\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-netns\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001173 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-sysctl-conf\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-host-slash\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001254 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2353c788-59df-444a-a10f-2cb3c7c9f236-host-run-netns\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-kubelet-config\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-k8s-cni-cncf-io\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001429 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/891c882b-1afa-44d2-9519-767eeebe12ed-host-run-k8s-cni-cncf-io\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001492 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-host-slash\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.001545 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-kubelet-config\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.002694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-tmp\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.002751 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72f8976b-30cc-4090-9e87-7557a4e44c62-etc-tuned\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.006639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.003553 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2353c788-59df-444a-a10f-2cb3c7c9f236-ovn-node-metrics-cert\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.009499 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.007722 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28ec8a8c-1aa3-4b2e-862a-e6640d0bf883-agent-certs\") pod \"konnectivity-agent-frknc\" (UID: \"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883\") " pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:03.011095 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.011074 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:03.011197 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.011103 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:03.011197 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.011116 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:03.011197 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.011169 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:03.511152914 +0000 UTC m=+3.022220802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:03.013900 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.013857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfvwj\" (UniqueName: \"kubernetes.io/projected/891c882b-1afa-44d2-9519-767eeebe12ed-kube-api-access-hfvwj\") pod \"multus-8pb9j\" (UID: \"891c882b-1afa-44d2-9519-767eeebe12ed\") " pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.014468 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.014444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9jxc\" (UniqueName: \"kubernetes.io/projected/8d4dab3f-7bc8-478b-b800-b914dfaf39f0-kube-api-access-p9jxc\") pod \"iptables-alerter-ww4jm\" (UID: \"8d4dab3f-7bc8-478b-b800-b914dfaf39f0\") " pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:03.016458 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.016435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54dg\" (UniqueName: \"kubernetes.io/projected/b3eed24a-f3ce-4080-804e-a0707e54e551-kube-api-access-l54dg\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:03.016558 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.016522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs27c\" (UniqueName: \"kubernetes.io/projected/5bd23456-fc65-4e6b-bda9-6fbec26ffeb2-kube-api-access-cs27c\") pod \"node-resolver-gm9g9\" (UID: \"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2\") " pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:03.017372 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.016927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhz9m\" (UniqueName: \"kubernetes.io/projected/e450dd62-d3d7-463e-84cd-d3add06d7f0d-kube-api-access-xhz9m\") pod \"multus-additional-cni-plugins-cwkwz\" (UID: \"e450dd62-d3d7-463e-84cd-d3add06d7f0d\") " pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.017372 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.016983 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nr5j\" (UniqueName: \"kubernetes.io/projected/eed9c43b-5736-49b0-9143-a2d4de9bf2fd-kube-api-access-6nr5j\") pod \"node-ca-bq5t7\" (UID: \"eed9c43b-5736-49b0-9143-a2d4de9bf2fd\") " pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:03.017372 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.017319 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxxq5\" (UniqueName: \"kubernetes.io/projected/72f8976b-30cc-4090-9e87-7557a4e44c62-kube-api-access-nxxq5\") pod \"tuned-jr45s\" (UID: \"72f8976b-30cc-4090-9e87-7557a4e44c62\") " pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.017553 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.017461 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4k9m\" (UniqueName: \"kubernetes.io/projected/2353c788-59df-444a-a10f-2cb3c7c9f236-kube-api-access-w4k9m\") pod \"ovnkube-node-ncqt7\" (UID: \"2353c788-59df-444a-a10f-2cb3c7c9f236\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.035312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.035219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"4420f29174221746d4074a8608b471e6","Type":"ContainerStarted","Data":"75f750cc1358e42f4c0379bd476f5fb0a8d8db65af885ae34947bfbd90f8aef1"} Jul 28 18:00:03.035312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.035289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"518b8e3a950744810faae7969fae1c45","Type":"ContainerStarted","Data":"352fd6addfa721c113571ec7dfd0c389b97ef04145ef232868067d4bd37baf24"} Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-device-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvll9\" (UniqueName: \"kubernetes.io/projected/792efb57-c4e2-43d8-9226-64d110a694ec-kube-api-access-lvll9\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102824 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.102910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103071 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-socket-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-device-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103448 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-sys-fs\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.103629 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.103598 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/792efb57-c4e2-43d8-9226-64d110a694ec-registration-dir\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.115373 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.115272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvll9\" (UniqueName: \"kubernetes.io/projected/792efb57-c4e2-43d8-9226-64d110a694ec-kube-api-access-lvll9\") pod \"aws-ebs-csi-driver-node-4mqlc\" (UID: \"792efb57-c4e2-43d8-9226-64d110a694ec\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.190742 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.190709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" Jul 28 18:00:03.196231 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.196208 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:03.207221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.207189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jr45s" Jul 28 18:00:03.213338 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.213318 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bq5t7" Jul 28 18:00:03.221594 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.221571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pb9j" Jul 28 18:00:03.228465 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.228443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gm9g9" Jul 28 18:00:03.236380 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.236359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ww4jm" Jul 28 18:00:03.243451 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.243430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:03.248217 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.248196 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" Jul 28 18:00:03.293690 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.293661 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 18:00:03.506238 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.506168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:03.506238 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.506217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:03.506442 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.506317 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:03.506442 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.506330 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:03.506442 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.506377 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:04.50635701 +0000 UTC m=+4.017424899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:03.506442 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.506397 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:04.506387499 +0000 UTC m=+4.017455381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:03.607484 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.607454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:03.607663 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.607619 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:03.607663 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.607640 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:03.607663 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.607649 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:03.607769 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:03.607706 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:04.607686128 +0000 UTC m=+4.118754024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:03.978345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.978270 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:55:02 +0000 UTC" deadline="2028-02-11 17:50:45.231189395 +0000 UTC" Jul 28 18:00:03.978345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:03.978301 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13511h50m41.252891617s" Jul 28 18:00:04.032994 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.032970 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ec8a8c_1aa3_4b2e_862a_e6640d0bf883.slice/crio-03fc1b386b0a855c584b4e3aa281fb4388e95c18d19fc45633a67834a35d1fd3 WatchSource:0}: Error finding container 03fc1b386b0a855c584b4e3aa281fb4388e95c18d19fc45633a67834a35d1fd3: Status 404 returned error can't find the container with id 03fc1b386b0a855c584b4e3aa281fb4388e95c18d19fc45633a67834a35d1fd3 Jul 28 18:00:04.035773 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.035745 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2353c788_59df_444a_a10f_2cb3c7c9f236.slice/crio-71e68aef619e585a3454592399bb9d141d8cd2dea4111c12fb7ad1e98702039a WatchSource:0}: Error finding container 71e68aef619e585a3454592399bb9d141d8cd2dea4111c12fb7ad1e98702039a: Status 404 returned error can't find the container with id 71e68aef619e585a3454592399bb9d141d8cd2dea4111c12fb7ad1e98702039a Jul 28 18:00:04.037542 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.037510 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frknc" event={"ID":"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883","Type":"ContainerStarted","Data":"03fc1b386b0a855c584b4e3aa281fb4388e95c18d19fc45633a67834a35d1fd3"} Jul 28 18:00:04.037660 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.037635 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode450dd62_d3d7_463e_84cd_d3add06d7f0d.slice/crio-568dfdee027a5e39ae2a831bcddc4cf4f038cd0b7d15fc07294b3a2bd98e7121 WatchSource:0}: Error finding container 568dfdee027a5e39ae2a831bcddc4cf4f038cd0b7d15fc07294b3a2bd98e7121: Status 404 returned error can't find the container with id 568dfdee027a5e39ae2a831bcddc4cf4f038cd0b7d15fc07294b3a2bd98e7121 Jul 28 18:00:04.038301 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.038240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d4dab3f_7bc8_478b_b800_b914dfaf39f0.slice/crio-70f1508c49ca1e577a89f32583cc1349d870ea77c3af39600d099ea36e04e863 WatchSource:0}: Error finding container 70f1508c49ca1e577a89f32583cc1349d870ea77c3af39600d099ea36e04e863: Status 404 returned error can't find the container with id 70f1508c49ca1e577a89f32583cc1349d870ea77c3af39600d099ea36e04e863 Jul 28 18:00:04.039543 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.039519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed9c43b_5736_49b0_9143_a2d4de9bf2fd.slice/crio-6c7091cda9a90c5b43cf46d9aebbdb157c289bd965c0639b96386c0baf33bab4 WatchSource:0}: Error finding container 6c7091cda9a90c5b43cf46d9aebbdb157c289bd965c0639b96386c0baf33bab4: Status 404 returned error can't find the container with id 6c7091cda9a90c5b43cf46d9aebbdb157c289bd965c0639b96386c0baf33bab4 Jul 28 18:00:04.041336 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.040783 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f8976b_30cc_4090_9e87_7557a4e44c62.slice/crio-9eaf6a79ae6d4c4e40b747aa9b6ec50508d8433c8ebe81b33f00e4d535eb3b6e WatchSource:0}: Error finding container 9eaf6a79ae6d4c4e40b747aa9b6ec50508d8433c8ebe81b33f00e4d535eb3b6e: Status 404 returned error can't find the container with id 9eaf6a79ae6d4c4e40b747aa9b6ec50508d8433c8ebe81b33f00e4d535eb3b6e Jul 28 18:00:04.042283 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.042199 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891c882b_1afa_44d2_9519_767eeebe12ed.slice/crio-c573a23b19a8a8d287e657f167dd59e11602216ef0b1d8843ce462c257d3e4f0 WatchSource:0}: Error finding container c573a23b19a8a8d287e657f167dd59e11602216ef0b1d8843ce462c257d3e4f0: Status 404 returned error can't find the container with id c573a23b19a8a8d287e657f167dd59e11602216ef0b1d8843ce462c257d3e4f0 Jul 28 18:00:04.043144 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:04.043125 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792efb57_c4e2_43d8_9226_64d110a694ec.slice/crio-721f1f01771c91cfd1ec9638969b9471662aecf4bb3768b393b0b5ea4eb0f569 WatchSource:0}: Error finding container 721f1f01771c91cfd1ec9638969b9471662aecf4bb3768b393b0b5ea4eb0f569: Status 404 returned error can't find the container with id 721f1f01771c91cfd1ec9638969b9471662aecf4bb3768b393b0b5ea4eb0f569 Jul 28 18:00:04.513806 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.513557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:04.513806 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.513797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:04.514029 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.513798 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:04.514029 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.513949 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:06.513927381 +0000 UTC m=+6.024995285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:04.514029 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.513859 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:04.514171 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.514035 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:06.514014287 +0000 UTC m=+6.025082183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:04.614389 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.614342 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:04.614939 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.614554 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:04.614939 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.614580 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:04.614939 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.614593 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:04.614939 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:04.614643 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:06.614630203 +0000 UTC m=+6.125698098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:04.979130 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.978889 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:55:02 +0000 UTC" deadline="2028-01-07 20:46:04.422891754 +0000 UTC" Jul 28 18:00:04.979130 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:04.978952 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12674h45m59.443944203s" Jul 28 18:00:05.024267 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.024233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:05.024417 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:05.024384 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:05.024800 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.024779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:05.024914 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:05.024893 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:05.024973 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.024956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:05.025039 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:05.025022 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:05.047334 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.047302 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" event={"ID":"792efb57-c4e2-43d8-9226-64d110a694ec","Type":"ContainerStarted","Data":"721f1f01771c91cfd1ec9638969b9471662aecf4bb3768b393b0b5ea4eb0f569"} Jul 28 18:00:05.053420 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.053389 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pb9j" event={"ID":"891c882b-1afa-44d2-9519-767eeebe12ed","Type":"ContainerStarted","Data":"c573a23b19a8a8d287e657f167dd59e11602216ef0b1d8843ce462c257d3e4f0"} Jul 28 18:00:05.059548 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.059503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jr45s" event={"ID":"72f8976b-30cc-4090-9e87-7557a4e44c62","Type":"ContainerStarted","Data":"9eaf6a79ae6d4c4e40b747aa9b6ec50508d8433c8ebe81b33f00e4d535eb3b6e"} Jul 28 18:00:05.063840 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.063813 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bq5t7" event={"ID":"eed9c43b-5736-49b0-9143-a2d4de9bf2fd","Type":"ContainerStarted","Data":"6c7091cda9a90c5b43cf46d9aebbdb157c289bd965c0639b96386c0baf33bab4"} Jul 28 18:00:05.067138 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.067114 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerStarted","Data":"568dfdee027a5e39ae2a831bcddc4cf4f038cd0b7d15fc07294b3a2bd98e7121"} Jul 28 18:00:05.072008 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.071979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"71e68aef619e585a3454592399bb9d141d8cd2dea4111c12fb7ad1e98702039a"} Jul 28 18:00:05.075262 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.075130 2561 generic.go:356] "Generic (PLEG): container finished" podID="4420f29174221746d4074a8608b471e6" containerID="e0c955e0f1ca556d2a3512f2cd53c9f19faf7608215c20d48bb3ae3df7dc5bd2" exitCode=0 Jul 28 18:00:05.075262 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.075215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"4420f29174221746d4074a8608b471e6","Type":"ContainerDied","Data":"e0c955e0f1ca556d2a3512f2cd53c9f19faf7608215c20d48bb3ae3df7dc5bd2"} Jul 28 18:00:05.079333 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.079305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" event={"ID":"518b8e3a950744810faae7969fae1c45","Type":"ContainerStarted","Data":"1c1eab2aea84164b1ba8a94d9f05fea243240a4578b46279ff2fb5e179cba7cc"} Jul 28 18:00:05.084993 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.084933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gm9g9" event={"ID":"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2","Type":"ContainerStarted","Data":"6e4261f10d0c65704293d1ac5856a39a6b042c8e1eb2e1a2996b6c9a40fc872d"} Jul 28 18:00:05.101830 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:05.101804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ww4jm" event={"ID":"8d4dab3f-7bc8-478b-b800-b914dfaf39f0","Type":"ContainerStarted","Data":"70f1508c49ca1e577a89f32583cc1349d870ea77c3af39600d099ea36e04e863"} Jul 28 18:00:06.126430 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.125978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" event={"ID":"4420f29174221746d4074a8608b471e6","Type":"ContainerStarted","Data":"3c556e5046830b6b6ce843a8b099d83c9e05ac917d6ee6042f6fd3f7e0f2cb2e"} Jul 28 18:00:06.144739 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.143811 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-105.ec2.internal" podStartSLOduration=4.143790563 podStartE2EDuration="4.143790563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:06.143589298 +0000 UTC m=+5.654657204" watchObservedRunningTime="2026-07-28 18:00:06.143790563 +0000 UTC m=+5.654858468" Jul 28 18:00:06.144739 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.144607 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-105.ec2.internal" podStartSLOduration=4.144593526 podStartE2EDuration="4.144593526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:05.109712814 +0000 UTC m=+4.620780732" watchObservedRunningTime="2026-07-28 18:00:06.144593526 +0000 UTC m=+5.655661431" Jul 28 18:00:06.530713 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.530626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:06.530713 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.530690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:06.530951 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.530835 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:06.530951 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.530910 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:10.5308924 +0000 UTC m=+10.041960285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:06.531328 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.531310 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:06.531425 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.531362 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:10.531346609 +0000 UTC m=+10.042414497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:06.631606 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:06.631569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:06.631780 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.631746 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:06.631780 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.631766 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:06.631780 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.631779 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:06.631966 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:06.631837 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:10.63181701 +0000 UTC m=+10.142884920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:07.023068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:07.022971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:07.023228 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:07.023118 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:07.023590 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:07.023512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:07.023661 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:07.023612 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:07.025685 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:07.025662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:07.025781 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:07.025752 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:09.021991 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:09.021958 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:09.022447 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:09.022072 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:09.022447 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:09.022414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:09.022566 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:09.022475 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:09.022624 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:09.022587 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:09.022677 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:09.022637 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:10.568348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:10.568449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.568587 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.568642 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:18.568626559 +0000 UTC m=+18.079694440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.569145 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:10.569262 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.569226 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:18.569184208 +0000 UTC m=+18.080252107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:10.669069 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:10.669024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:10.669294 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.669226 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:10.669294 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.669248 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:10.669294 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.669261 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:10.669477 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:10.669317 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:18.669300811 +0000 UTC m=+18.180368711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:11.023045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:11.023160 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:11.023482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:11.023552 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:11.023591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:11.025295 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:11.023641 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:13.023727 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:13.023696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:13.024218 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:13.023804 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:13.024218 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:13.024191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:13.024351 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:13.024286 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:13.024351 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:13.024343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:13.024449 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:13.024407 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:15.022743 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:15.022650 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:15.022743 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:15.022678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:15.023248 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:15.022785 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:15.023248 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:15.022911 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:15.023248 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:15.022970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:15.023248 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:15.023051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:17.022661 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:17.022625 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:17.022661 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:17.022681 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:17.023210 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:17.022796 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:17.023210 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:17.022892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:17.023210 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:17.022986 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:17.023210 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:17.023069 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:18.631041 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:18.631003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:18.631446 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:18.631054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:18.631446 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.631155 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:18.631446 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.631157 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:18.631446 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.631211 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:34.631196599 +0000 UTC m=+34.142264501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:18.631446 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.631226 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:34.631219659 +0000 UTC m=+34.142287540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:18.732262 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:18.732175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:18.732425 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.732376 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:18.732425 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.732404 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:18.732425 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.732418 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:18.732556 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:18.732481 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:00:34.732462331 +0000 UTC m=+34.243530227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:19.022619 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:19.022539 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:19.022619 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:19.022575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:19.022834 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:19.022546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:19.022834 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:19.022676 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:19.022834 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:19.022753 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:19.022834 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:19.022817 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:21.022734 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:21.022686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:21.023251 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:21.022805 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:21.023251 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:21.022818 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:21.023251 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:21.022928 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:21.023251 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:21.022983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:21.023251 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:21.023047 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:23.022797 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.022488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:23.023581 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.022488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:23.023581 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:23.022903 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:23.023581 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.022488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:23.023581 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:23.022963 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:23.023581 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:23.023014 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:23.166075 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.166040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pb9j" event={"ID":"891c882b-1afa-44d2-9519-767eeebe12ed","Type":"ContainerStarted","Data":"bd74fdb53750f77412fe88d166873b8f9b524492a66b2452413234b7eed3a9e4"} Jul 28 18:00:23.167435 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.167412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jr45s" event={"ID":"72f8976b-30cc-4090-9e87-7557a4e44c62","Type":"ContainerStarted","Data":"8f5bc96db2a5c8948d4cba58a0ab00b24bdd75ac645a36a1316d24ad0338e3ee"} Jul 28 18:00:23.168786 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.168758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bq5t7" event={"ID":"eed9c43b-5736-49b0-9143-a2d4de9bf2fd","Type":"ContainerStarted","Data":"25f6e9baa4dbc0198e3c5fe04a3e86d306f6d8b70f5325adc9a752681b7fe070"} Jul 28 18:00:23.170486 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.170447 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="fb9c5809cba188b512e853974ade5e606c81dde219169f57c1128561a917fe33" exitCode=0 Jul 28 18:00:23.170486 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.170478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"fb9c5809cba188b512e853974ade5e606c81dde219169f57c1128561a917fe33"} Jul 28 18:00:23.173515 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.173495 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"5023f65f59e01b7da7acdd54e45f2148806d4474569afec525a6b3451f5022a0"} Jul 28 18:00:23.173596 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.173569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"b084a1ba920b8cd9e7643751bf1def83c114abbeb509bd9075a057f016d75123"} Jul 28 18:00:23.173663 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.173621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"6bed1fabce581f3d8771f04f12576c18fad4b25ca5008db6af5272b9b155b131"} Jul 28 18:00:23.173721 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.173670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"0ed086648f95adb1915dc9a67c555efbc655148abe4ac12d836a52cc840dae45"} Jul 28 18:00:23.175512 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.175493 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gm9g9" event={"ID":"5bd23456-fc65-4e6b-bda9-6fbec26ffeb2","Type":"ContainerStarted","Data":"06bbb1a6663792e2f0c1f9d19dafc066eb494a318cce7a7414869ad25c79c29b"} Jul 28 18:00:23.177112 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.177091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frknc" event={"ID":"28ec8a8c-1aa3-4b2e-862a-e6640d0bf883","Type":"ContainerStarted","Data":"412ab8ad6ce1294272188434a421dee03800f6ec64e37e7e8ace37ca82aa79ef"} Jul 28 18:00:23.178628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.178606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" event={"ID":"792efb57-c4e2-43d8-9226-64d110a694ec","Type":"ContainerStarted","Data":"13035256cba7b0878c306155949a9202b685f65f94195ff2651656c5cfeb35b8"} Jul 28 18:00:23.188079 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.188030 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8pb9j" podStartSLOduration=3.593249889 podStartE2EDuration="22.188010634s" totalImagesPullingTime="18.594760745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:23.187282568 +0000 UTC m=+22.698350472" watchObservedRunningTime="2026-07-28 18:00:23.188010634 +0000 UTC m=+22.699078538" Jul 28 18:00:23.227719 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.227679 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jr45s" podStartSLOduration=3.677375986 podStartE2EDuration="22.227663498s" totalImagesPullingTime="18.550287512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:23.227429774 +0000 UTC m=+22.738497679" watchObservedRunningTime="2026-07-28 18:00:23.227663498 +0000 UTC m=+22.738731402" Jul 28 18:00:23.243181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.243132 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-frknc" podStartSLOduration=7.79685108 podStartE2EDuration="22.243113191s" totalImagesPullingTime="14.446262111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:23.243082654 +0000 UTC m=+22.754150559" watchObservedRunningTime="2026-07-28 18:00:23.243113191 +0000 UTC m=+22.754181094" Jul 28 18:00:23.260361 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.260319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bq5t7" podStartSLOduration=3.726122686 podStartE2EDuration="22.260306668s" totalImagesPullingTime="18.534183982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:23.260156118 +0000 UTC m=+22.771224021" watchObservedRunningTime="2026-07-28 18:00:23.260306668 +0000 UTC m=+22.771374572" Jul 28 18:00:23.276679 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.276640 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gm9g9" podStartSLOduration=3.746142162 podStartE2EDuration="22.276625031s" totalImagesPullingTime="18.530482869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:23.276457222 +0000 UTC m=+22.787525128" watchObservedRunningTime="2026-07-28 18:00:23.276625031 +0000 UTC m=+22.787692935" Jul 28 18:00:23.342420 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.342282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:23.418357 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.418320 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:23.493230 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:23.493186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:24.184032 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.183994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"c98219bde41fec0700771cfa4bdf164ff2a4f50b0854a1cb87a50b1b842f3f05"} Jul 28 18:00:24.184466 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.184122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"0a152e66efbb472a9147857fd97b78f64d6777d1d3da6694a93876848f4b53ad"} Jul 28 18:00:24.185658 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.185625 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ww4jm" event={"ID":"8d4dab3f-7bc8-478b-b800-b914dfaf39f0","Type":"ContainerStarted","Data":"b012893dbfc662ddc5fca3a4e31cc22c50e21d0735c99efe801e9d4d287542bd"} Jul 28 18:00:24.206478 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.206429 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 18:00:24.345668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.345595 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:24.439060 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.439009 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:24.543736 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.543701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:24.964966 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.964821 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T18:00:24.206444447Z","UUID":"1a4dac9b-bc26-4d90-a726-3f1d998a5712","Handler":null,"Name":"","Endpoint":""} Jul 28 18:00:24.966718 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.966692 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 18:00:24.966939 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:24.966754 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 18:00:25.022435 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:25.022403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:25.022606 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:25.022444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:25.022606 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:25.022406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:25.022606 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:25.022546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:25.022769 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:25.022627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:25.022769 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:25.022702 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:25.191089 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:25.191034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" event={"ID":"792efb57-c4e2-43d8-9226-64d110a694ec","Type":"ContainerStarted","Data":"2678bc8a3df326785fe3cca5ab2e2d2c6f30ecc1c7daf4b3dc74dc9ba1c32a1f"} Jul 28 18:00:26.196545 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:26.196505 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" event={"ID":"792efb57-c4e2-43d8-9226-64d110a694ec","Type":"ContainerStarted","Data":"fb2f1d8054182d5cbfabee5d48aeb2ad540db82929f53fb42cc889df02e39003"} Jul 28 18:00:26.200786 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:26.200757 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"ad4dbd835559f50843c2346d0666109b57cb4960be09bc1efec75d2bf9339c6e"} Jul 28 18:00:26.217724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:26.217680 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ww4jm" podStartSLOduration=6.679447646 podStartE2EDuration="25.217662218s" totalImagesPullingTime="18.538214572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:24.203299058 +0000 UTC m=+23.714366961" watchObservedRunningTime="2026-07-28 18:00:26.217662218 +0000 UTC m=+25.728730123" Jul 28 18:00:26.217845 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:26.217774 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mqlc" podStartSLOduration=4.033858871 podStartE2EDuration="25.217768676s" totalImagesPullingTime="21.183909805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:26.216602859 +0000 UTC m=+25.727670763" watchObservedRunningTime="2026-07-28 18:00:26.217768676 +0000 UTC m=+25.728836579" Jul 28 18:00:27.022674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:27.022475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:27.022860 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:27.022475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:27.022860 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:27.022764 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:27.022860 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:27.022515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:27.022860 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:27.022847 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:27.023074 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:27.022968 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:27.362087 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:27.362011 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:27.362717 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:27.362694 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:28.172064 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.172026 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:28.207458 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.207429 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="01498c24c866beb52c3e7b960b37354e35c389e56ace6b0741eb8d761086e079" exitCode=0 Jul 28 18:00:28.207614 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.207503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"01498c24c866beb52c3e7b960b37354e35c389e56ace6b0741eb8d761086e079"} Jul 28 18:00:28.211198 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.211172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" event={"ID":"2353c788-59df-444a-a10f-2cb3c7c9f236","Type":"ContainerStarted","Data":"e0b5219b26c45e728d856806a4262fcaff374f92037f5313c62c413397a91b54"} Jul 28 18:00:28.211906 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.211685 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:28.212013 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.211966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-frknc" Jul 28 18:00:28.262476 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.262429 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" podStartSLOduration=8.661973347 podStartE2EDuration="27.26241307s" totalImagesPullingTime="18.600439723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:28.262065543 +0000 UTC m=+27.773133450" watchObservedRunningTime="2026-07-28 18:00:28.26241307 +0000 UTC m=+27.773480975" Jul 28 18:00:28.262563 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.262475 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:28.341599 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:28.341530 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:29.022480 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.022365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:29.023482 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.022954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:29.023482 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:29.022966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:29.023961 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.023938 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:29.024325 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:29.024271 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:29.024710 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:29.024688 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:29.213466 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.213432 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:29.213687 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.213503 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:29.213687 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.213540 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:29.228762 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.228738 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:29.228963 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:29.228952 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:00:30.046781 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.046750 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j6989"] Jul 28 18:00:30.047369 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.046899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:30.047369 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:30.047046 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:30.050182 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.050157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9bnn"] Jul 28 18:00:30.050315 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.050231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:30.050371 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:30.050314 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:30.051035 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.050999 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t46rm"] Jul 28 18:00:30.051145 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.051098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:30.051216 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:30.051198 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:30.216810 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.216724 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="2505577197de0edfe5f39dc2897211dd6c8da16b7852e28d6f660568b3920a04" exitCode=0 Jul 28 18:00:30.217003 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:30.216804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"2505577197de0edfe5f39dc2897211dd6c8da16b7852e28d6f660568b3920a04"} Jul 28 18:00:32.022930 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:32.022733 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:32.023290 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:32.022733 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:32.023290 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:32.023000 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:32.023290 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:32.022733 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:32.023290 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:32.023091 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:32.023290 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:32.023177 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:32.223924 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:32.223823 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="2b22bcca67f7f82c7c874108188012d477789f62b025e5c65efd0995d722ca34" exitCode=0 Jul 28 18:00:32.223924 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:32.223893 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"2b22bcca67f7f82c7c874108188012d477789f62b025e5c65efd0995d722ca34"} Jul 28 18:00:34.022271 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.022238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:34.022810 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.022286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:34.022810 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.022356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:34.022810 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.022368 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:34.022810 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.022480 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:34.022810 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.022568 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:34.650382 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.650345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:34.650562 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.650436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:34.650562 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.650503 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:34.650562 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.650530 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:34.650724 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.650586 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs podName:b3eed24a-f3ce-4080-804e-a0707e54e551 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:06.650567163 +0000 UTC m=+66.161635061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs") pod "network-metrics-daemon-t46rm" (UID: "b3eed24a-f3ce-4080-804e-a0707e54e551") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 18:00:34.650724 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.650603 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret podName:14750f95-880a-4f86-bc46-ff4a4bb6bc9a nodeName:}" failed. No retries permitted until 2026-07-28 18:01:06.650595067 +0000 UTC m=+66.161662950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret") pod "global-pull-secret-syncer-j6989" (UID: "14750f95-880a-4f86-bc46-ff4a4bb6bc9a") : object "kube-system"/"original-pull-secret" not registered Jul 28 18:00:34.750738 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:34.750700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:34.750906 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.750847 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 18:00:34.750906 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.750861 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 18:00:34.750906 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.750890 2561 projected.go:196] Error preparing data for projected volume kube-api-access-7g5zm for pod openshift-network-diagnostics/network-check-target-k9bnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:34.751034 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:34.750941 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm podName:c951c29c-2e34-4985-8190-5dbdb61c129f nodeName:}" failed. No retries permitted until 2026-07-28 18:01:06.750927264 +0000 UTC m=+66.261995158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7g5zm" (UniqueName: "kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm") pod "network-check-target-k9bnn" (UID: "c951c29c-2e34-4985-8190-5dbdb61c129f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 18:00:35.275466 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:35.275431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:35.369585 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:35.369546 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:35.464749 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:35.464712 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:36.022038 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.022000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:36.022213 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.022004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:36.022213 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:36.022121 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t46rm" podUID="b3eed24a-f3ce-4080-804e-a0707e54e551" Jul 28 18:00:36.022213 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.022127 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:36.022213 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:36.022204 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j6989" podUID="14750f95-880a-4f86-bc46-ff4a4bb6bc9a" Jul 28 18:00:36.022382 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:36.022279 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k9bnn" podUID="c951c29c-2e34-4985-8190-5dbdb61c129f" Jul 28 18:00:36.237645 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.237603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerStarted","Data":"d82a2c8ab4126b85a663823b55da288486bb9827d711c794c6b1d6a85942d19e"} Jul 28 18:00:36.327134 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.327106 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:36.347403 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.347371 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-105.ec2.internal" event="NodeReady" Jul 28 18:00:36.347515 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.347505 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 18:00:36.407941 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.407908 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qzgbc"] Jul 28 18:00:36.410178 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.410153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.410937 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.410915 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6skgf"] Jul 28 18:00:36.412434 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.412413 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 18:00:36.412510 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.412488 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 18:00:36.412787 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.412749 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpvqd\"" Jul 28 18:00:36.412959 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.412943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.415276 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.415254 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwt5j\"" Jul 28 18:00:36.415276 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.415270 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 18:00:36.415544 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.415529 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 18:00:36.415638 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.415550 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 18:00:36.422550 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.422526 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qzgbc"] Jul 28 18:00:36.424972 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.424951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6skgf"] Jul 28 18:00:36.563790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-tmp-dir\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.563790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.563790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-cert\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.563790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-config-volume\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.564079 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfg5z\" (UniqueName: \"kubernetes.io/projected/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-kube-api-access-zfg5z\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.564079 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.563962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2x7\" (UniqueName: \"kubernetes.io/projected/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-kube-api-access-5q2x7\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.665031 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.664980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-tmp-dir\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.665031 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.665270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-cert\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.665270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-config-volume\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.665270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfg5z\" (UniqueName: \"kubernetes.io/projected/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-kube-api-access-zfg5z\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.665270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2x7\" (UniqueName: \"kubernetes.io/projected/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-kube-api-access-5q2x7\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.665270 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:36.665216 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:36.665464 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:36.665299 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:37.165278319 +0000 UTC m=+36.676346201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:36.665464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665310 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-tmp-dir\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.665683 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.665661 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-config-volume\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.669509 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.669493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-cert\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.676240 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.676212 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfg5z\" (UniqueName: \"kubernetes.io/projected/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-kube-api-access-zfg5z\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:36.676470 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.676448 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2x7\" (UniqueName: \"kubernetes.io/projected/eee2bfb3-3188-4dc4-b597-3cbc8e8704aa-kube-api-access-5q2x7\") pod \"ingress-canary-6skgf\" (UID: \"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa\") " pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.726484 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.726448 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6skgf" Jul 28 18:00:36.869641 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:36.869453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6skgf"] Jul 28 18:00:36.873046 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:36.873022 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee2bfb3_3188_4dc4_b597_3cbc8e8704aa.slice/crio-9cfb430e6f7bb4086d7795c4cd8df91fdabc6b8b4e920fc260e41b69591fe685 WatchSource:0}: Error finding container 9cfb430e6f7bb4086d7795c4cd8df91fdabc6b8b4e920fc260e41b69591fe685: Status 404 returned error can't find the container with id 9cfb430e6f7bb4086d7795c4cd8df91fdabc6b8b4e920fc260e41b69591fe685 Jul 28 18:00:37.138468 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.138387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:37.169542 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.169502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:37.169703 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:37.169657 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:37.169741 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:37.169725 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:38.16970948 +0000 UTC m=+37.680777365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:37.212628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.212594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:37.243065 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.243037 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="d82a2c8ab4126b85a663823b55da288486bb9827d711c794c6b1d6a85942d19e" exitCode=0 Jul 28 18:00:37.243245 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.243116 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"d82a2c8ab4126b85a663823b55da288486bb9827d711c794c6b1d6a85942d19e"} Jul 28 18:00:37.244410 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.244196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6skgf" event={"ID":"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa","Type":"ContainerStarted","Data":"9cfb430e6f7bb4086d7795c4cd8df91fdabc6b8b4e920fc260e41b69591fe685"} Jul 28 18:00:37.312273 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:37.312243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:38.022266 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.022223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:00:38.022902 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.022273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:00:38.022902 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.022223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:00:38.025279 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.025258 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 18:00:38.025393 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.025261 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:00:38.025460 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.025264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:00:38.026381 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.026062 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvkg8\"" Jul 28 18:00:38.026381 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.026197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hrc4\"" Jul 28 18:00:38.026381 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.026063 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 18:00:38.178103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.178052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:38.178294 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:38.178221 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:38.178362 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:38.178304 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:40.178282968 +0000 UTC m=+39.689350851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:38.250157 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.250116 2561 generic.go:356] "Generic (PLEG): container finished" podID="e450dd62-d3d7-463e-84cd-d3add06d7f0d" containerID="715dee1e119c4800cc413c6e61c5b8bc2349001f79b25dc1f5b4d232a25e8d51" exitCode=0 Jul 28 18:00:38.250320 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:38.250198 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerDied","Data":"715dee1e119c4800cc413c6e61c5b8bc2349001f79b25dc1f5b4d232a25e8d51"} Jul 28 18:00:39.255855 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:39.255674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" event={"ID":"e450dd62-d3d7-463e-84cd-d3add06d7f0d","Type":"ContainerStarted","Data":"299a81997c0f0a515a4aec69d168944c52f84eec8a2e3138924362b860f8e0d2"} Jul 28 18:00:39.282473 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:39.282431 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cwkwz" podStartSLOduration=9.159296066 podStartE2EDuration="38.282415142s" totalImagesPullingTime="29.123119076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:39.280688955 +0000 UTC m=+38.791756859" watchObservedRunningTime="2026-07-28 18:00:39.282415142 +0000 UTC m=+38.793483046" Jul 28 18:00:39.427963 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:39.427935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:39.524954 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:39.524846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:40.129213 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.129180 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:40.193674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.193647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:40.193811 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:40.193795 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:40.193885 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:40.193859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.193844287 +0000 UTC m=+43.704912169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:40.259755 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.259727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6skgf" event={"ID":"eee2bfb3-3188-4dc4-b597-3cbc8e8704aa","Type":"ContainerStarted","Data":"3a281d0fc32d3c2f94cfb0702e5e2aaf41ee57d5d3e820d12a8ef617c793bb8e"} Jul 28 18:00:40.293965 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.293915 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6skgf" podStartSLOduration=1.797806836 podStartE2EDuration="4.29390069s" totalImagesPullingTime="2.496093854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:40.293626229 +0000 UTC m=+39.804694133" watchObservedRunningTime="2026-07-28 18:00:40.29390069 +0000 UTC m=+39.804968594" Jul 28 18:00:40.869997 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.869971 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf"] Jul 28 18:00:40.891746 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.891711 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58"] Jul 28 18:00:40.891930 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.891840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" Jul 28 18:00:40.894465 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.894440 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:40.894594 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.894441 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wwkp4\"" Jul 28 18:00:40.894594 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.894484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:40.906084 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.906056 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf"] Jul 28 18:00:40.906179 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.906084 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58"] Jul 28 18:00:40.906179 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.906168 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:40.908539 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.908521 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 18:00:40.908641 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.908564 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:40.908811 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.908794 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:40.908950 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.908934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 18:00:40.909014 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.908952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dsv8n\"" Jul 28 18:00:40.980389 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.980365 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5"] Jul 28 18:00:40.999078 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.999057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc4c786-d3f1-4d64-b725-149e1990ce7d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:40.999233 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.999103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnznw\" (UniqueName: \"kubernetes.io/projected/3bc4c786-d3f1-4d64-b725-149e1990ce7d-kube-api-access-vnznw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:40.999233 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.999188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc4c786-d3f1-4d64-b725-149e1990ce7d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:40.999341 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:40.999301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtjmn\" (UniqueName: \"kubernetes.io/projected/c040c207-26f7-4457-bbdb-c2c30a21ccd9-kube-api-access-vtjmn\") pod \"volume-data-source-validator-549c6d54cf-ql9gf\" (UID: \"c040c207-26f7-4457-bbdb-c2c30a21ccd9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" Jul 28 18:00:41.005609 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.005581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5"] Jul 28 18:00:41.005685 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.005659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.008385 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.008363 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zm7dv\"" Jul 28 18:00:41.008487 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.008386 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 18:00:41.008625 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.008601 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 18:00:41.008691 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.008675 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 18:00:41.009721 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.009700 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 18:00:41.074835 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.074808 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8q6rh"] Jul 28 18:00:41.095628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.095608 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2"] Jul 28 18:00:41.095739 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.095725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.097940 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.097922 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 18:00:41.098040 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.097951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7cfb4\"" Jul 28 18:00:41.098209 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.098189 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 18:00:41.098587 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.098567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 18:00:41.098668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.098641 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 18:00:41.099552 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnznw\" (UniqueName: \"kubernetes.io/projected/3bc4c786-d3f1-4d64-b725-149e1990ce7d-kube-api-access-vnznw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.099648 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc4c786-d3f1-4d64-b725-149e1990ce7d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.099648 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/563f8985-56bb-4384-9d63-c2a797fd30c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.099760 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vd4w\" (UniqueName: \"kubernetes.io/projected/563f8985-56bb-4384-9d63-c2a797fd30c1-kube-api-access-8vd4w\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.099760 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtjmn\" (UniqueName: \"kubernetes.io/projected/c040c207-26f7-4457-bbdb-c2c30a21ccd9-kube-api-access-vtjmn\") pod \"volume-data-source-validator-549c6d54cf-ql9gf\" (UID: \"c040c207-26f7-4457-bbdb-c2c30a21ccd9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" Jul 28 18:00:41.099853 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc4c786-d3f1-4d64-b725-149e1990ce7d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.099853 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.099812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.100391 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.100367 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bc4c786-d3f1-4d64-b725-149e1990ce7d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.108741 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.104858 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bc4c786-d3f1-4d64-b725-149e1990ce7d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.110613 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.110595 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 18:00:41.115265 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.115239 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnznw\" (UniqueName: \"kubernetes.io/projected/3bc4c786-d3f1-4d64-b725-149e1990ce7d-kube-api-access-vnznw\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58\" (UID: \"3bc4c786-d3f1-4d64-b725-149e1990ce7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.115475 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.115457 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtjmn\" (UniqueName: \"kubernetes.io/projected/c040c207-26f7-4457-bbdb-c2c30a21ccd9-kube-api-access-vtjmn\") pod \"volume-data-source-validator-549c6d54cf-ql9gf\" (UID: \"c040c207-26f7-4457-bbdb-c2c30a21ccd9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" Jul 28 18:00:41.115813 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.115796 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76cd5788c8-cl9l6"] Jul 28 18:00:41.115940 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.115925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.118225 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.118207 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 18:00:41.118306 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.118242 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qhgcs\"" Jul 28 18:00:41.118524 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.118508 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 18:00:41.118818 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.118801 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 18:00:41.119018 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.118809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 18:00:41.135950 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.135934 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl"] Jul 28 18:00:41.136050 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.136036 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.138194 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.138177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 18:00:41.138298 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.138285 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hfls\"" Jul 28 18:00:41.138373 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.138339 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 18:00:41.138483 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.138471 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 18:00:41.144993 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.144977 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 18:00:41.152148 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.152133 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8q6rh"] Jul 28 18:00:41.152206 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.152158 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl"] Jul 28 18:00:41.152206 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.152173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2"] Jul 28 18:00:41.152206 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.152184 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76cd5788c8-cl9l6"] Jul 28 18:00:41.152298 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.152226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.154672 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.154659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 18:00:41.154750 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.154685 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c9hlc\"" Jul 28 18:00:41.154750 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.154708 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 18:00:41.200472 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200448 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" Jul 28 18:00:41.200626 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/563f8985-56bb-4384-9d63-c2a797fd30c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.200683 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-service-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.200683 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vd4w\" (UniqueName: \"kubernetes.io/projected/563f8985-56bb-4384-9d63-c2a797fd30c1-kube-api-access-8vd4w\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.200750 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.200797 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c263e0f3-02ae-414c-9d1b-83c2987b1f31-serving-cert\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.200860 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.200846 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:41.200945 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200892 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9nn\" (UniqueName: \"kubernetes.io/projected/c263e0f3-02ae-414c-9d1b-83c2987b1f31-kube-api-access-jj9nn\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.200945 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.200929 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.700907971 +0000 UTC m=+41.211975854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:41.201037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.200953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-tmp\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.201037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.201012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-snapshots\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.201102 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.201045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.201365 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.201350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/563f8985-56bb-4384-9d63-c2a797fd30c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.213141 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.213124 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vd4w\" (UniqueName: \"kubernetes.io/projected/563f8985-56bb-4384-9d63-c2a797fd30c1-kube-api-access-8vd4w\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.213856 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.213835 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" Jul 28 18:00:41.236107 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.236090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:41.302260 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.302605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-snapshots\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.302605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-config\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.302605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.302605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.302605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-serving-cert\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6r6m\" (UniqueName: \"kubernetes.io/projected/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-kube-api-access-h6r6m\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c263e0f3-02ae-414c-9d1b-83c2987b1f31-serving-cert\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9nn\" (UniqueName: \"kubernetes.io/projected/c263e0f3-02ae-414c-9d1b-83c2987b1f31-kube-api-access-jj9nn\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-tmp\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.302846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-service-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.302964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.303010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.303035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxkw6\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.303242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.303084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-snapshots\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.304010 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.303960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-service-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.304174 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.304149 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c263e0f3-02ae-414c-9d1b-83c2987b1f31-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.304299 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.304262 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c263e0f3-02ae-414c-9d1b-83c2987b1f31-tmp\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.306526 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.306484 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c263e0f3-02ae-414c-9d1b-83c2987b1f31-serving-cert\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.319046 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.318848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9nn\" (UniqueName: \"kubernetes.io/projected/c263e0f3-02ae-414c-9d1b-83c2987b1f31-kube-api-access-jj9nn\") pod \"insights-operator-5885fdb759-8q6rh\" (UID: \"c263e0f3-02ae-414c-9d1b-83c2987b1f31\") " pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.320327 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.320191 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:41.354160 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.354134 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf"] Jul 28 18:00:41.357011 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:41.356983 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc040c207_26f7_4457_bbdb_c2c30a21ccd9.slice/crio-401c9be6f848684809d51969547d2245d55b6c17c1fa85c8ccac81eccf689bcf WatchSource:0}: Error finding container 401c9be6f848684809d51969547d2245d55b6c17c1fa85c8ccac81eccf689bcf: Status 404 returned error can't find the container with id 401c9be6f848684809d51969547d2245d55b6c17c1fa85c8ccac81eccf689bcf Jul 28 18:00:41.374212 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.374190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58"] Jul 28 18:00:41.376920 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:41.376897 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc4c786_d3f1_4d64_b725_149e1990ce7d.slice/crio-6903e5df4d8845a368d2337b5b89d2835ce87f1d547059823f9ad5a77b8f370d WatchSource:0}: Error finding container 6903e5df4d8845a368d2337b5b89d2835ce87f1d547059823f9ad5a77b8f370d: Status 404 returned error can't find the container with id 6903e5df4d8845a368d2337b5b89d2835ce87f1d547059823f9ad5a77b8f370d Jul 28 18:00:41.403377 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-serving-cert\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.403492 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6r6m\" (UniqueName: \"kubernetes.io/projected/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-kube-api-access-h6r6m\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.403492 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403492 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.403492 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403492 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403473 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxkw6\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-config\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403731 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.403863 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.403900 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.403938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.403978 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.403960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.903942673 +0000 UTC m=+41.415010578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:41.404426 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.404107 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:41.404426 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.404150 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:41.9041353 +0000 UTC m=+41.415203197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:41.404426 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.404181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.404426 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.404381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-config\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.404725 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.404705 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.405189 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.405158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.405698 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.405669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" Jul 28 18:00:41.405782 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.405726 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:41.406090 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.406070 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-serving-cert\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.406345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.406329 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.406467 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.406453 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.414732 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.414710 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxkw6\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.414817 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.414801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6r6m\" (UniqueName: \"kubernetes.io/projected/ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9-kube-api-access-h6r6m\") pod \"service-ca-operator-5d6c75f84f-lhsj2\" (UID: \"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.415612 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.415597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.429753 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.429737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" Jul 28 18:00:41.483362 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.483323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:41.569250 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.569221 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8q6rh"] Jul 28 18:00:41.582188 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:41.582146 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc263e0f3_02ae_414c_9d1b_83c2987b1f31.slice/crio-2c312dc373bf89a17246f03168938d0db6b0938b3168d2c2f16ebf40cbb81c66 WatchSource:0}: Error finding container 2c312dc373bf89a17246f03168938d0db6b0938b3168d2c2f16ebf40cbb81c66: Status 404 returned error can't find the container with id 2c312dc373bf89a17246f03168938d0db6b0938b3168d2c2f16ebf40cbb81c66 Jul 28 18:00:41.612518 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.612487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2"] Jul 28 18:00:41.616498 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:00:41.616473 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5e3dd6_91d4_4b8c_970c_e85d3ab8a5e9.slice/crio-a0bedc60ebd3a9edac28b6a62890284110a07b49131aefd43c0376e481d6277b WatchSource:0}: Error finding container a0bedc60ebd3a9edac28b6a62890284110a07b49131aefd43c0376e481d6277b: Status 404 returned error can't find the container with id a0bedc60ebd3a9edac28b6a62890284110a07b49131aefd43c0376e481d6277b Jul 28 18:00:41.705588 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.705501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:41.705738 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.705622 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:41.705738 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.705696 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.705679364 +0000 UTC m=+42.216747268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:41.907755 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.907719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:41.907976 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:41.907774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:41.907976 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.907899 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:41.907976 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.907920 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:41.907976 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.907931 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:41.907976 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.907969 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.907953995 +0000 UTC m=+42.419021877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:41.908157 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:41.907987 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:42.907980271 +0000 UTC m=+42.419048153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:42.167524 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.167476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:42.246417 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.246349 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:42.266571 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.266535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" event={"ID":"c263e0f3-02ae-414c-9d1b-83c2987b1f31","Type":"ContainerStarted","Data":"2c312dc373bf89a17246f03168938d0db6b0938b3168d2c2f16ebf40cbb81c66"} Jul 28 18:00:42.268003 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.267966 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" event={"ID":"3bc4c786-d3f1-4d64-b725-149e1990ce7d","Type":"ContainerStarted","Data":"6903e5df4d8845a368d2337b5b89d2835ce87f1d547059823f9ad5a77b8f370d"} Jul 28 18:00:42.269373 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.269325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" event={"ID":"c040c207-26f7-4457-bbdb-c2c30a21ccd9","Type":"ContainerStarted","Data":"401c9be6f848684809d51969547d2245d55b6c17c1fa85c8ccac81eccf689bcf"} Jul 28 18:00:42.270619 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.270593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" event={"ID":"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9","Type":"ContainerStarted","Data":"a0bedc60ebd3a9edac28b6a62890284110a07b49131aefd43c0376e481d6277b"} Jul 28 18:00:42.565402 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.565362 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:42.635567 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.635528 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:42.713802 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.713765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:42.713991 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.713971 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:42.714066 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.714046 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.714026356 +0000 UTC m=+44.225094238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:42.915922 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.915815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:42.916066 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:42.915926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:42.916066 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.916002 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:42.916195 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.916082 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.916058861 +0000 UTC m=+44.427126766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:42.916195 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.916089 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:42.916195 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.916108 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:42.916195 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:42.916158 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:44.916141319 +0000 UTC m=+44.427209228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:43.275633 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:43.275593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" event={"ID":"c040c207-26f7-4457-bbdb-c2c30a21ccd9","Type":"ContainerStarted","Data":"d2a90ca309c68448f6fa11536a0ecf1508851a4f03bedef78ea55169bc72f237"} Jul 28 18:00:44.227563 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.227516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:44.228042 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.227695 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:44.228042 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.227749 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:52.227735331 +0000 UTC m=+51.738803214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:44.388004 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.387954 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:44.488597 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.488569 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:44.732796 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.732750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:44.732954 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.732923 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:44.733008 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.732992 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.732974227 +0000 UTC m=+48.244042109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:44.934427 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.934340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:44.934588 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:44.934499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:44.934588 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.934527 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:44.934588 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.934551 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:44.934759 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.934618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.93460351 +0000 UTC m=+48.445671396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:44.934759 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.934624 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:44.934759 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:44.934667 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.934656189 +0000 UTC m=+48.445724075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:46.284811 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.284773 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" event={"ID":"c263e0f3-02ae-414c-9d1b-83c2987b1f31","Type":"ContainerStarted","Data":"09a0dca160184525b8fc5a136ff835f46e9c987eafb75e923bfa7e26dc71a2b7"} Jul 28 18:00:46.286326 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.286298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" event={"ID":"3bc4c786-d3f1-4d64-b725-149e1990ce7d","Type":"ContainerStarted","Data":"fe49aa50cce2f476127c92e357388053bb6789db4f763161798c020b90e977d6"} Jul 28 18:00:46.287749 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.287730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" event={"ID":"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9","Type":"ContainerStarted","Data":"440e38424098c3102c978d6b398eac348c4aecf296c10908251d4d0680e83d65"} Jul 28 18:00:46.307415 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.307360 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" podStartSLOduration=1.423093125 podStartE2EDuration="5.307335988s" totalImagesPullingTime="3.884242863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:46.306579001 +0000 UTC m=+45.817646907" watchObservedRunningTime="2026-07-28 18:00:46.307335988 +0000 UTC m=+45.818403870" Jul 28 18:00:46.307703 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.307675 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-ql9gf" podStartSLOduration=4.528774436 podStartE2EDuration="6.307666685s" totalImagesPullingTime="1.778892249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:44.295894702 +0000 UTC m=+43.806962610" watchObservedRunningTime="2026-07-28 18:00:46.307666685 +0000 UTC m=+45.818734598" Jul 28 18:00:46.324069 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.324012 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" podStartSLOduration=1.474158307 podStartE2EDuration="5.323990405s" totalImagesPullingTime="3.849832098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:46.322619822 +0000 UTC m=+45.833687727" watchObservedRunningTime="2026-07-28 18:00:46.323990405 +0000 UTC m=+45.835058310" Jul 28 18:00:46.351044 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.346056 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" podStartSLOduration=2.247890975 podStartE2EDuration="6.346034405s" totalImagesPullingTime="4.09814343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:00:46.345162119 +0000 UTC m=+45.856230005" watchObservedRunningTime="2026-07-28 18:00:46.346034405 +0000 UTC m=+45.857102311" Jul 28 18:00:46.480819 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.480777 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8dslv"] Jul 28 18:00:46.502348 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.502307 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.502635 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.502606 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dslv"] Jul 28 18:00:46.507119 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.507090 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 18:00:46.507311 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.507183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 18:00:46.507311 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.507182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cgwfk\"" Jul 28 18:00:46.515979 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.515955 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:46.549555 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.549481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.549707 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.549570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-crio-socket\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.549707 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.549602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkdgj\" (UniqueName: \"kubernetes.io/projected/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-api-access-dkdgj\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.549707 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.549632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.549707 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.549686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-data-volume\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.644250 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.644218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:46.650435 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650575 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-crio-socket\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650575 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:46.650532 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:46.650575 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkdgj\" (UniqueName: \"kubernetes.io/projected/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-api-access-dkdgj\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650718 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650718 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-data-volume\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650718 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:46.650674 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.150645388 +0000 UTC m=+46.661713279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : configmap "kube-rbac-proxy" not found Jul 28 18:00:46.650892 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:46.650749 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:46.650892 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650746 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-crio-socket\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.650892 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:46.650812 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:47.15079438 +0000 UTC m=+46.661862262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:46.651048 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.650966 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-data-volume\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:46.660343 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:46.660315 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkdgj\" (UniqueName: \"kubernetes.io/projected/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-api-access-dkdgj\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:47.003335 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.003308 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:47.154464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.154427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:47.154668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.154539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:47.154668 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:47.154577 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:47.154668 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:47.154643 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:47.154668 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:47.154655 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.154637412 +0000 UTC m=+47.665705296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : configmap "kube-rbac-proxy" not found Jul 28 18:00:47.154898 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:47.154682 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:48.154671682 +0000 UTC m=+47.665739563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:47.279690 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.279609 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:47.392014 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.391982 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:47.783569 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.783537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:47.933671 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.933635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gm9g9_5bd23456-fc65-4e6b-bda9-6fbec26ffeb2/dns-node-resolver/0.log" Jul 28 18:00:47.934449 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:47.934424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:48.037570 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.037444 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:48.163529 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.163487 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:48.163735 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.163613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:48.163735 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.163642 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:48.163735 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.163716 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:48.163910 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.163747 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:50.163724568 +0000 UTC m=+49.674792454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : configmap "kube-rbac-proxy" not found Jul 28 18:00:48.163910 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.163769 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:50.16375883 +0000 UTC m=+49.674826714 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:48.768608 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.768573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:48.769008 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.768729 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:48.769008 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.768794 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.768778442 +0000 UTC m=+56.279846343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:48.816879 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.816846 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:48.887579 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.887545 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:48.933814 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.933785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bq5t7_eed9c43b-5736-49b0-9143-a2d4de9bf2fd/node-ca/0.log" Jul 28 18:00:48.951668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.951643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:48.971141 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.971109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:48.971277 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:48.971259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:48.971316 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.971275 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:48.971316 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.971291 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:48.971390 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.971352 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.9713342 +0000 UTC m=+56.482402103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:48.971390 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.971363 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:48.971457 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:48.971401 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:56.971391239 +0000 UTC m=+56.482459121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:49.402199 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:49.402163 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:49.499785 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:49.499754 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:49.737643 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:49.737618 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6skgf_eee2bfb3-3188-4dc4-b597-3cbc8e8704aa/serve-healthcheck-canary/0.log" Jul 28 18:00:49.816932 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:49.816897 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:50.182316 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:50.182224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:50.182316 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:50.182282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:50.182515 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:50.182359 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:50.182515 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:50.182408 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:50.182515 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:50.182415 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:54.182400353 +0000 UTC m=+53.693468235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : configmap "kube-rbac-proxy" not found Jul 28 18:00:50.182515 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:50.182478 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:00:54.182458257 +0000 UTC m=+53.693526147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:52.230343 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:52.230299 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:52.297969 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:52.297926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:00:52.298161 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:52.298096 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 18:00:52.298211 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:52.298171 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls podName:ef6b27ec-2dd3-4176-b5b3-76a04d1acb50 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:08.298153238 +0000 UTC m=+67.809221131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls") pod "dns-default-qzgbc" (UID: "ef6b27ec-2dd3-4176-b5b3-76a04d1acb50") : secret "dns-default-metrics-tls" not found Jul 28 18:00:54.213424 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:54.213382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:54.213966 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:54.213457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:00:54.213966 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:54.213545 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:00:54.213966 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:54.213547 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 18:00:54.213966 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:54.213612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:02.213594818 +0000 UTC m=+61.724662704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:00:54.213966 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:54.213658 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:02.213642344 +0000 UTC m=+61.724710230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : configmap "kube-rbac-proxy" not found Jul 28 18:00:55.067413 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:55.067378 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:55.168404 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:55.168374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:55.496821 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:55.496790 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:56.834601 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:56.834563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:00:56.835081 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:56.834717 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:56.835081 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:56.834798 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls podName:563f8985-56bb-4384-9d63-c2a797fd30c1 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:12.834782725 +0000 UTC m=+72.345850607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-d79g5" (UID: "563f8985-56bb-4384-9d63-c2a797fd30c1") : secret "cluster-monitoring-operator-tls" not found Jul 28 18:00:57.007566 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.007536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:57.036252 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.036223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:00:57.036435 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.036283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:00:57.036435 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:57.036373 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 18:00:57.036435 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:57.036381 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 18:00:57.036435 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:57.036391 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76cd5788c8-cl9l6: secret "image-registry-tls" not found Jul 28 18:00:57.036580 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:57.036449 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls podName:3d996b42-ba5f-4aaf-a6cc-29e925dab13a nodeName:}" failed. No retries permitted until 2026-07-28 18:01:13.036433179 +0000 UTC m=+72.547501064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls") pod "image-registry-76cd5788c8-cl9l6" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a") : secret "image-registry-tls" not found Jul 28 18:00:57.036580 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:00:57.036462 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert podName:1d6df677-cdb8-4ee1-aa60-a14c992efdc9 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:13.036456049 +0000 UTC m=+72.547523931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-bbnrl" (UID: "1d6df677-cdb8-4ee1-aa60-a14c992efdc9") : secret "networking-console-plugin-cert" not found Jul 28 18:00:57.108039 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.107953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:57.181242 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.181209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:57.493246 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.493218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:57.887036 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:57.886958 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:58.290064 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:58.290031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:58.354741 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:58.354709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:58.490253 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:58.490218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:58.889891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:58.889836 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:59.412411 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:59.412377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:59.513094 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:59.513065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:59.686049 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:59.685962 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:00:59.762464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:00:59.762435 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.180890 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.180840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.254898 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.254857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncqt7" Jul 28 18:01:01.282308 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.282273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.362468 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.362431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.497393 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.497363 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.575525 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.575491 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.698141 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.698104 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:01.941907 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:01.941807 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:02.282426 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:02.282379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:02.282822 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:02.282448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:02.282822 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:02.282530 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 18:01:02.282822 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:02.282598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls podName:1faf6d5f-f43c-4103-844e-eb5496a8a7f9 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:18.282580966 +0000 UTC m=+77.793648849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dslv" (UID: "1faf6d5f-f43c-4103-844e-eb5496a8a7f9") : secret "insights-runtime-extractor-tls" not found Jul 28 18:01:02.282960 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:02.282930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:03.742886 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:03.742850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:03.845398 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:03.845373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:04.094166 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:04.094090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:04.288584 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:04.288553 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:04.494009 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:04.493978 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:04.687340 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:04.687306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:04.887165 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:04.887086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:06.714004 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.713956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:01:06.714429 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.714029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:01:06.718879 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.718849 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 18:01:06.719622 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.719607 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 18:01:06.727310 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.727286 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14750f95-880a-4f86-bc46-ff4a4bb6bc9a-original-pull-secret\") pod \"global-pull-secret-syncer-j6989\" (UID: \"14750f95-880a-4f86-bc46-ff4a4bb6bc9a\") " pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:01:06.727417 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.727399 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3eed24a-f3ce-4080-804e-a0707e54e551-metrics-certs\") pod \"network-metrics-daemon-t46rm\" (UID: \"b3eed24a-f3ce-4080-804e-a0707e54e551\") " pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:01:06.814791 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.814753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:01:06.817793 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.817772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 18:01:06.828606 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.828580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 18:01:06.833554 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.833521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j6989" Jul 28 18:01:06.838426 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.838401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5zm\" (UniqueName: \"kubernetes.io/projected/c951c29c-2e34-4985-8190-5dbdb61c129f-kube-api-access-7g5zm\") pod \"network-check-target-k9bnn\" (UID: \"c951c29c-2e34-4985-8190-5dbdb61c129f\") " pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:01:06.847241 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.847215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvkg8\"" Jul 28 18:01:06.853923 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.853820 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hrc4\"" Jul 28 18:01:06.854526 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.854413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t46rm" Jul 28 18:01:06.862286 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.862257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:01:06.984975 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:06.984856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j6989"] Jul 28 18:01:06.990273 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:06.990237 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14750f95_880a_4f86_bc46_ff4a4bb6bc9a.slice/crio-fcd68c25bbdc2d9aea3bcb9d76d61651090645577d244c5f5b8ba5dc285af1f2 WatchSource:0}: Error finding container fcd68c25bbdc2d9aea3bcb9d76d61651090645577d244c5f5b8ba5dc285af1f2: Status 404 returned error can't find the container with id fcd68c25bbdc2d9aea3bcb9d76d61651090645577d244c5f5b8ba5dc285af1f2 Jul 28 18:01:07.015693 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.015652 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t46rm"] Jul 28 18:01:07.018508 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:07.018477 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3eed24a_f3ce_4080_804e_a0707e54e551.slice/crio-455e0dceef4ad596087583807bc4305dc2b5f5a930c74c98971a8f9846486191 WatchSource:0}: Error finding container 455e0dceef4ad596087583807bc4305dc2b5f5a930c74c98971a8f9846486191: Status 404 returned error can't find the container with id 455e0dceef4ad596087583807bc4305dc2b5f5a930c74c98971a8f9846486191 Jul 28 18:01:07.031605 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.031579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k9bnn"] Jul 28 18:01:07.033819 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:07.033795 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc951c29c_2e34_4985_8190_5dbdb61c129f.slice/crio-8963217e79b3a32ef41e43b366daac0c673701136d018347a4e39173487977fb WatchSource:0}: Error finding container 8963217e79b3a32ef41e43b366daac0c673701136d018347a4e39173487977fb: Status 404 returned error can't find the container with id 8963217e79b3a32ef41e43b366daac0c673701136d018347a4e39173487977fb Jul 28 18:01:07.345177 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.345136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9bnn" event={"ID":"c951c29c-2e34-4985-8190-5dbdb61c129f","Type":"ContainerStarted","Data":"8963217e79b3a32ef41e43b366daac0c673701136d018347a4e39173487977fb"} Jul 28 18:01:07.346354 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.346324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j6989" event={"ID":"14750f95-880a-4f86-bc46-ff4a4bb6bc9a","Type":"ContainerStarted","Data":"fcd68c25bbdc2d9aea3bcb9d76d61651090645577d244c5f5b8ba5dc285af1f2"} Jul 28 18:01:07.347493 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.347469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t46rm" event={"ID":"b3eed24a-f3ce-4080-804e-a0707e54e551","Type":"ContainerStarted","Data":"455e0dceef4ad596087583807bc4305dc2b5f5a930c74c98971a8f9846486191"} Jul 28 18:01:07.659500 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.659407 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:07.776419 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:07.776388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:08.329701 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:08.329663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:01:08.332162 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:08.332142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef6b27ec-2dd3-4176-b5b3-76a04d1acb50-metrics-tls\") pod \"dns-default-qzgbc\" (UID: \"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50\") " pod="openshift-dns/dns-default-qzgbc" Jul 28 18:01:08.523595 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:08.523560 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cpvqd\"" Jul 28 18:01:08.531458 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:08.531419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qzgbc" Jul 28 18:01:08.708948 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:08.708911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qzgbc"] Jul 28 18:01:08.715983 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:08.715954 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6b27ec_2dd3_4176_b5b3_76a04d1acb50.slice/crio-87f527f3852579ed3797231de6d8218da1349c5310185edcc97102a2f7a5a2f0 WatchSource:0}: Error finding container 87f527f3852579ed3797231de6d8218da1349c5310185edcc97102a2f7a5a2f0: Status 404 returned error can't find the container with id 87f527f3852579ed3797231de6d8218da1349c5310185edcc97102a2f7a5a2f0 Jul 28 18:01:09.357491 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:09.357455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t46rm" event={"ID":"b3eed24a-f3ce-4080-804e-a0707e54e551","Type":"ContainerStarted","Data":"0a480bfc5eaa85bcfcc5cff7217e4d8a8cd11110dc466a381c3b782012efb474"} Jul 28 18:01:09.357983 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:09.357514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t46rm" event={"ID":"b3eed24a-f3ce-4080-804e-a0707e54e551","Type":"ContainerStarted","Data":"799d9c521bbbf64bddeceaf03d387883c8cfe29b982a0d4b62ce4237326c2ced"} Jul 28 18:01:09.359086 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:09.359059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzgbc" event={"ID":"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50","Type":"ContainerStarted","Data":"87f527f3852579ed3797231de6d8218da1349c5310185edcc97102a2f7a5a2f0"} Jul 28 18:01:09.377075 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:09.376530 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t46rm" podStartSLOduration=66.932335995 podStartE2EDuration="1m8.376509497s" totalImagesPullingTime="1.444173502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:09.375478086 +0000 UTC m=+68.886545990" watchObservedRunningTime="2026-07-28 18:01:09.376509497 +0000 UTC m=+68.887577400" Jul 28 18:01:12.221171 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.221125 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76cd5788c8-cl9l6"] Jul 28 18:01:12.221660 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:12.221349 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" podUID="3d996b42-ba5f-4aaf-a6cc-29e925dab13a" Jul 28 18:01:12.245004 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.244973 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l"] Jul 28 18:01:12.248397 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.248375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.250764 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.250743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 28 18:01:12.250887 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.250782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 18:01:12.251129 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.251108 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 18:01:12.251285 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.251260 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 18:01:12.259647 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.259618 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l"] Jul 28 18:01:12.317980 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.317944 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:12.341951 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.341914 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc4f88865-68tzp"] Jul 28 18:01:12.344319 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.344292 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.360164 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.360139 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc4f88865-68tzp"] Jul 28 18:01:12.363161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.363136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfngg\" (UniqueName: \"kubernetes.io/projected/bd0bf1e7-01a3-420e-95a4-04f29d442463-kube-api-access-sfngg\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.363291 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.363216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd0bf1e7-01a3-420e-95a4-04f29d442463-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.363291 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.363265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0bf1e7-01a3-420e-95a4-04f29d442463-tmp\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.370835 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.370564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:01:12.377051 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.377033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:01:12.413859 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.413826 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:12.463598 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463566 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.463785 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463640 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxkw6\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.463785 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463695 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.463785 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463737 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.463785 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463764 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.464037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463795 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.464037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463851 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:12.464037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.463975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-certificates\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464005 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd933b84-d859-4d74-9c35-83ac28a4d3f0-ca-trust-extracted\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464228 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfngg\" (UniqueName: \"kubernetes.io/projected/bd0bf1e7-01a3-420e-95a4-04f29d442463-kube-api-access-sfngg\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.464228 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-bound-sa-token\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464228 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxzkl\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-kube-api-access-rxzkl\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464228 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-image-registry-private-configuration\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464228 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-trusted-ca\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd0bf1e7-01a3-420e-95a4-04f29d442463-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.464464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-tls\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-installation-pull-secrets\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.464464 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0bf1e7-01a3-420e-95a4-04f29d442463-tmp\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.464813 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.464785 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0bf1e7-01a3-420e-95a4-04f29d442463-tmp\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.465146 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.465100 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 18:01:12.465246 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.465179 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:01:12.465307 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.465236 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:01:12.468433 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.468404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bd0bf1e7-01a3-420e-95a4-04f29d442463-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.469026 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.468972 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:01:12.469026 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.468987 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6" (OuterVolumeSpecName: "kube-api-access-vxkw6") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "kube-api-access-vxkw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:01:12.469174 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.469057 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:01:12.470064 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.470025 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:01:12.483978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.483950 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfngg\" (UniqueName: \"kubernetes.io/projected/bd0bf1e7-01a3-420e-95a4-04f29d442463-kube-api-access-sfngg\") pod \"klusterlet-addon-workmgr-5c9786957f-qd74l\" (UID: \"bd0bf1e7-01a3-420e-95a4-04f29d442463\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.509981 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.509953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:12.560352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.560317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:12.565706 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-bound-sa-token\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.565820 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxzkl\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-kube-api-access-rxzkl\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.565820 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-image-registry-private-configuration\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.565820 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-trusted-ca\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566010 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-tls\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566010 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565926 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-installation-pull-secrets\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566010 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.565993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-certificates\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd933b84-d859-4d74-9c35-83ac28a4d3f0-ca-trust-extracted\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566064 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-image-registry-private-configuration\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566081 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-bound-sa-token\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566097 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-certificates\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566112 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-ca-trust-extracted\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566130 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-installation-pull-secrets\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566145 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-trusted-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566161 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566158 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxkw6\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-kube-api-access-vxkw6\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:12.566533 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566473 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd933b84-d859-4d74-9c35-83ac28a4d3f0-ca-trust-extracted\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.566710 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.566691 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-trusted-ca\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.567068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.567012 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-certificates\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.568795 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.568771 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-registry-tls\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.568928 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.568809 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-installation-pull-secrets\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.569154 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.569135 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd933b84-d859-4d74-9c35-83ac28a4d3f0-image-registry-private-configuration\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.583038 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.583016 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxzkl\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-kube-api-access-rxzkl\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.583205 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.583184 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd933b84-d859-4d74-9c35-83ac28a4d3f0-bound-sa-token\") pod \"image-registry-7bc4f88865-68tzp\" (UID: \"cd933b84-d859-4d74-9c35-83ac28a4d3f0\") " pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.613528 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.613495 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:12.657592 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.657565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4hfls\"" Jul 28 18:01:12.664421 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.664396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:12.705194 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.705121 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:12.867837 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.867803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:01:12.870524 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:12.870498 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/563f8985-56bb-4384-9d63-c2a797fd30c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-d79g5\" (UID: \"563f8985-56bb-4384-9d63-c2a797fd30c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:01:13.070081 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.069953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:01:13.070081 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.070020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:01:13.073005 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.072979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6df677-cdb8-4ee1-aa60-a14c992efdc9-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-bbnrl\" (UID: \"1d6df677-cdb8-4ee1-aa60-a14c992efdc9\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:01:13.073945 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.073925 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"image-registry-76cd5788c8-cl9l6\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:01:13.122674 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.122439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zm7dv\"" Jul 28 18:01:13.126913 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.125354 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" Jul 28 18:01:13.174734 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.174688 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") pod \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\" (UID: \"3d996b42-ba5f-4aaf-a6cc-29e925dab13a\") " Jul 28 18:01:13.178546 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.178497 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d996b42-ba5f-4aaf-a6cc-29e925dab13a" (UID: "3d996b42-ba5f-4aaf-a6cc-29e925dab13a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:01:13.187076 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.186682 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:13.236670 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.236282 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc4f88865-68tzp"] Jul 28 18:01:13.261331 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.261253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l"] Jul 28 18:01:13.264735 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.264518 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c9hlc\"" Jul 28 18:01:13.271983 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.271827 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" Jul 28 18:01:13.276104 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.275814 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3d996b42-ba5f-4aaf-a6cc-29e925dab13a-registry-tls\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:01:13.290125 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.290098 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:13.328347 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.327898 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5"] Jul 28 18:01:13.330893 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:13.330811 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563f8985_56bb_4384_9d63_c2a797fd30c1.slice/crio-cf9e23873ac3199ba62aefac79ce814ce9c6b1ebcdc82b4ff3a93d2a6d008615 WatchSource:0}: Error finding container cf9e23873ac3199ba62aefac79ce814ce9c6b1ebcdc82b4ff3a93d2a6d008615: Status 404 returned error can't find the container with id cf9e23873ac3199ba62aefac79ce814ce9c6b1ebcdc82b4ff3a93d2a6d008615 Jul 28 18:01:13.382718 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.382182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k9bnn" event={"ID":"c951c29c-2e34-4985-8190-5dbdb61c129f","Type":"ContainerStarted","Data":"dc19a2244d9aa92a143be355759d0342bb2cf98cef18932e4471404f9a4fba92"} Jul 28 18:01:13.382922 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.382899 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:01:13.384724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.384685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j6989" event={"ID":"14750f95-880a-4f86-bc46-ff4a4bb6bc9a","Type":"ContainerStarted","Data":"c49df2c96adf76fefcda01714b2dadcd6d5753c2ecd8cb555574f06288b0a686"} Jul 28 18:01:13.386468 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.386442 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" event={"ID":"bd0bf1e7-01a3-420e-95a4-04f29d442463","Type":"ContainerStarted","Data":"e3c4c4551aaadbb3ae1cdf9fe2a5ca7efb116a1b3807e523dd36e0af7f84d884"} Jul 28 18:01:13.387727 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.387698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" event={"ID":"563f8985-56bb-4384-9d63-c2a797fd30c1","Type":"ContainerStarted","Data":"cf9e23873ac3199ba62aefac79ce814ce9c6b1ebcdc82b4ff3a93d2a6d008615"} Jul 28 18:01:13.390384 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.390255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:13.390384 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.390259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzgbc" event={"ID":"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50","Type":"ContainerStarted","Data":"be23b4ba64eda2e7fe1365cdfe581c92df5b3b19745378bff9842165b6896425"} Jul 28 18:01:13.390384 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.390333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qzgbc" event={"ID":"ef6b27ec-2dd3-4176-b5b3-76a04d1acb50","Type":"ContainerStarted","Data":"9a4f0db9ecd82201a383d03368cec019ed83c38395270e28a8590c76a1ee7bba"} Jul 28 18:01:13.390598 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.390551 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qzgbc" Jul 28 18:01:13.392543 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.392330 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76cd5788c8-cl9l6" Jul 28 18:01:13.392543 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.392403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" event={"ID":"cd933b84-d859-4d74-9c35-83ac28a4d3f0","Type":"ContainerStarted","Data":"f5d1398c8d39135eabe15355bede1c3a90812defa2888c25868ac5b5a07d4409"} Jul 28 18:01:13.392543 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.392450 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" event={"ID":"cd933b84-d859-4d74-9c35-83ac28a4d3f0","Type":"ContainerStarted","Data":"a6aa26cd2b1345d32e407188f295fbdf3e74716f52f62346c2d86a30d51a5acf"} Jul 28 18:01:13.402707 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.402572 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k9bnn" podStartSLOduration=66.363791404 podStartE2EDuration="1m12.402556121s" totalImagesPullingTime="6.038764717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:13.40233051 +0000 UTC m=+72.913398429" watchObservedRunningTime="2026-07-28 18:01:13.402556121 +0000 UTC m=+72.913624023" Jul 28 18:01:13.422902 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.422810 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" podStartSLOduration=1.422788978 podStartE2EDuration="1.422788978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:13.422025737 +0000 UTC m=+72.933093652" watchObservedRunningTime="2026-07-28 18:01:13.422788978 +0000 UTC m=+72.933856882" Jul 28 18:01:13.437042 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.437014 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl"] Jul 28 18:01:13.439531 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.439474 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j6989" podStartSLOduration=66.35926826 podStartE2EDuration="1m12.439456811s" totalImagesPullingTime="6.080188551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:13.438435061 +0000 UTC m=+72.949502966" watchObservedRunningTime="2026-07-28 18:01:13.439456811 +0000 UTC m=+72.950524716" Jul 28 18:01:13.440022 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:13.439751 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6df677_cdb8_4ee1_aa60_a14c992efdc9.slice/crio-822c5c8557f7069035aef12b1d43290e2bcbfa458479aa4a99a05194c140584e WatchSource:0}: Error finding container 822c5c8557f7069035aef12b1d43290e2bcbfa458479aa4a99a05194c140584e: Status 404 returned error can't find the container with id 822c5c8557f7069035aef12b1d43290e2bcbfa458479aa4a99a05194c140584e Jul 28 18:01:13.470468 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.470434 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:13.474150 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.474127 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76cd5788c8-cl9l6"] Jul 28 18:01:13.482736 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.482713 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76cd5788c8-cl9l6"] Jul 28 18:01:13.501703 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.501656 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qzgbc" podStartSLOduration=33.15389974 podStartE2EDuration="37.501640466s" totalImagesPullingTime="4.347740726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:13.50100147 +0000 UTC m=+73.012069371" watchObservedRunningTime="2026-07-28 18:01:13.501640466 +0000 UTC m=+73.012708420" Jul 28 18:01:13.644560 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.644474 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:13.744673 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:13.744633 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:14.399514 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:14.399471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" event={"ID":"1d6df677-cdb8-4ee1-aa60-a14c992efdc9","Type":"ContainerStarted","Data":"822c5c8557f7069035aef12b1d43290e2bcbfa458479aa4a99a05194c140584e"} Jul 28 18:01:14.400134 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:14.400109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:15.028387 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.028351 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d996b42-ba5f-4aaf-a6cc-29e925dab13a" path="/var/lib/kubelet/pods/3d996b42-ba5f-4aaf-a6cc-29e925dab13a/volumes" Jul 28 18:01:15.403471 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.403439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" event={"ID":"1d6df677-cdb8-4ee1-aa60-a14c992efdc9","Type":"ContainerStarted","Data":"2ef49fc19e58aa7a6f039542f98a485383f72f0bbfbe1c918290f46e63e44edf"} Jul 28 18:01:15.550392 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.550323 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:15.615444 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.615390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:15.728642 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.728526 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:15.827343 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.827312 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:15.916081 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:15.915974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:16.040498 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:16.040462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:16.409973 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:16.409863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" event={"ID":"563f8985-56bb-4384-9d63-c2a797fd30c1","Type":"ContainerStarted","Data":"09f71b54a470e8c28cef3b4fa5d05a6c0ed7fc5510f5374b409acae7467289ad"} Jul 28 18:01:16.429596 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:16.429537 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-bbnrl" podStartSLOduration=34.162713502 podStartE2EDuration="35.429514552s" totalImagesPullingTime="1.26680105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:15.420325361 +0000 UTC m=+74.931393286" watchObservedRunningTime="2026-07-28 18:01:16.429514552 +0000 UTC m=+75.940582456" Jul 28 18:01:16.430062 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:16.430015 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-d79g5" podStartSLOduration=34.389312051 podStartE2EDuration="36.43000218s" totalImagesPullingTime="2.040690129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:16.42862632 +0000 UTC m=+75.939694225" watchObservedRunningTime="2026-07-28 18:01:16.43000218 +0000 UTC m=+75.941070085" Jul 28 18:01:18.321119 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:18.321068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:18.323846 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:18.323814 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1faf6d5f-f43c-4103-844e-eb5496a8a7f9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dslv\" (UID: \"1faf6d5f-f43c-4103-844e-eb5496a8a7f9\") " pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:18.616220 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:18.616152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cgwfk\"" Jul 28 18:01:18.624456 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:18.624428 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dslv" Jul 28 18:01:18.951828 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:18.951801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dslv"] Jul 28 18:01:18.954719 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:18.954691 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1faf6d5f_f43c_4103_844e_eb5496a8a7f9.slice/crio-dbe4a99db16da20314f73023a69614cf0a238a0f41545ccb80d23a93c7f55674 WatchSource:0}: Error finding container dbe4a99db16da20314f73023a69614cf0a238a0f41545ccb80d23a93c7f55674: Status 404 returned error can't find the container with id dbe4a99db16da20314f73023a69614cf0a238a0f41545ccb80d23a93c7f55674 Jul 28 18:01:19.422181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:19.422145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dslv" event={"ID":"1faf6d5f-f43c-4103-844e-eb5496a8a7f9","Type":"ContainerStarted","Data":"dbe4a99db16da20314f73023a69614cf0a238a0f41545ccb80d23a93c7f55674"} Jul 28 18:01:19.423852 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:19.423816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" event={"ID":"bd0bf1e7-01a3-420e-95a4-04f29d442463","Type":"ContainerStarted","Data":"689c305a6490292c37856063731aebff3b93ca8d4feec51ba55c9fb12a94724b"} Jul 28 18:01:19.424038 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:19.424020 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:19.425947 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:19.425922 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" Jul 28 18:01:19.445520 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:19.445474 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c9786957f-qd74l" podStartSLOduration=1.880433106 podStartE2EDuration="7.445459488s" totalImagesPullingTime="5.565026382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:19.444365161 +0000 UTC m=+78.955433058" watchObservedRunningTime="2026-07-28 18:01:19.445459488 +0000 UTC m=+78.956527370" Jul 28 18:01:20.053719 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:20.053683 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:20.145700 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:20.145669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:21.301047 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:21.300909 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:21.478425 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:21.478389 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:21.577769 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:21.577691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:21.644768 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:21.644737 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:21.962390 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:21.962313 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:22.038088 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:22.038056 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:23.402583 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:23.402547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qzgbc" Jul 28 18:01:24.449034 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:24.448985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dslv" event={"ID":"1faf6d5f-f43c-4103-844e-eb5496a8a7f9","Type":"ContainerStarted","Data":"6f849c4eeefb9477ae7ea46b07d27297c746d57fe3993a683f145afc5ca6ea83"} Jul 28 18:01:25.483761 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:25.483672 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:25.583145 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:25.583100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:26.497633 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:26.497591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:27.463733 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:27.463696 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dslv" event={"ID":"1faf6d5f-f43c-4103-844e-eb5496a8a7f9","Type":"ContainerStarted","Data":"4ff5052ef3e7ef3cd99565d5e34ff4ad7ee4ae57ff10c01cdb08ca9c3fbf1c7c"} Jul 28 18:01:29.142296 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.142262 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.385348 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.385307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.460322 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.460231 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hbhfz"] Jul 28 18:01:29.464533 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.464505 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.466821 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.466793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 18:01:29.467138 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.467104 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 18:01:29.467255 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.467149 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 18:01:29.468352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.468311 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-552db\"" Jul 28 18:01:29.468805 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.468787 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 18:01:29.477427 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.477401 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46"] Jul 28 18:01:29.480438 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.480409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.482860 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.482837 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xh2zb\"" Jul 28 18:01:29.482987 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.482922 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 18:01:29.483128 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.482981 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 18:01:29.491630 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.491606 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46"] Jul 28 18:01:29.502299 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.502259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.613702 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-sys\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cd9c6e-b6be-49ac-82e1-87a9cae24756-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-metrics-client-ca\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-textfile\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-tls\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.613891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.614124 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hll\" (UniqueName: \"kubernetes.io/projected/64cd9c6e-b6be-49ac-82e1-87a9cae24756-kube-api-access-f7hll\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.614124 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.614124 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.613979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-wtmp\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.614124 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.614019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bcww\" (UniqueName: \"kubernetes.io/projected/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-kube-api-access-7bcww\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.614124 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.614062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-root\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.697616 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.697570 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.714483 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cd9c6e-b6be-49ac-82e1-87a9cae24756-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.714483 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-metrics-client-ca\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714483 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-textfile\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714483 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-tls\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hll\" (UniqueName: \"kubernetes.io/projected/64cd9c6e-b6be-49ac-82e1-87a9cae24756-kube-api-access-f7hll\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-wtmp\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bcww\" (UniqueName: \"kubernetes.io/projected/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-kube-api-access-7bcww\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-root\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-sys\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.714809 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.714802 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-sys\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.715552 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.715522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64cd9c6e-b6be-49ac-82e1-87a9cae24756-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.716021 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.715997 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-accelerators-collector-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.716425 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.716403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-wtmp\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.716526 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.716469 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-metrics-client-ca\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.716526 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:29.716475 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 28 18:01:29.716616 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:29.716567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls podName:64cd9c6e-b6be-49ac-82e1-87a9cae24756 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:30.216544394 +0000 UTC m=+89.727612283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-bzp46" (UID: "64cd9c6e-b6be-49ac-82e1-87a9cae24756") : secret "openshift-state-metrics-tls" not found Jul 28 18:01:29.716616 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.716597 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-root\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.716700 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.716667 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-textfile\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.718603 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.718580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.719334 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.719307 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.719724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.719704 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-node-exporter-tls\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.729355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.729333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bcww\" (UniqueName: \"kubernetes.io/projected/a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3-kube-api-access-7bcww\") pod \"node-exporter-hbhfz\" (UID: \"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3\") " pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.729716 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.729693 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hll\" (UniqueName: \"kubernetes.io/projected/64cd9c6e-b6be-49ac-82e1-87a9cae24756-kube-api-access-f7hll\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:29.776497 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.776316 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hbhfz" Jul 28 18:01:29.794036 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.793999 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.897032 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.896994 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:29.994096 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:29.994061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:30.128432 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.128388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:30.218582 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.218545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:30.221608 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.221579 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64cd9c6e-b6be-49ac-82e1-87a9cae24756-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bzp46\" (UID: \"64cd9c6e-b6be-49ac-82e1-87a9cae24756\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:30.391135 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.391045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" Jul 28 18:01:30.418635 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.418590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:30.521116 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.521081 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:30.617315 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.617260 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:30.843260 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:30.843222 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ebfbe8_997b_4b74_ba66_7caa2f4a64c3.slice/crio-808a01c4dbc9c515dce0dd436e41f4d58f9fa8ba501f0b5f9787ac7594172c7d WatchSource:0}: Error finding container 808a01c4dbc9c515dce0dd436e41f4d58f9fa8ba501f0b5f9787ac7594172c7d: Status 404 returned error can't find the container with id 808a01c4dbc9c515dce0dd436e41f4d58f9fa8ba501f0b5f9787ac7594172c7d Jul 28 18:01:30.979208 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:30.979164 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46"] Jul 28 18:01:30.983138 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:30.983098 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cd9c6e_b6be_49ac_82e1_87a9cae24756.slice/crio-42e52f190ed151918cd0451e4a6d72576e9294a80d14bf63ff0c84b6de5e7b2c WatchSource:0}: Error finding container 42e52f190ed151918cd0451e4a6d72576e9294a80d14bf63ff0c84b6de5e7b2c: Status 404 returned error can't find the container with id 42e52f190ed151918cd0451e4a6d72576e9294a80d14bf63ff0c84b6de5e7b2c Jul 28 18:01:31.076418 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.076388 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:31.181158 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.181117 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:31.423577 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.423489 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5488d564b7-2xv2c"] Jul 28 18:01:31.426814 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.426789 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.429476 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.429456 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 18:01:31.429644 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.429625 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 18:01:31.429854 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.429839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 18:01:31.429962 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.429859 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bmuhockkbj5gh\"" Jul 28 18:01:31.430305 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.430086 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 18:01:31.430305 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.430105 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 18:01:31.430305 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.430158 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4hzn4\"" Jul 28 18:01:31.440540 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.440516 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5488d564b7-2xv2c"] Jul 28 18:01:31.482507 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.482474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dslv" event={"ID":"1faf6d5f-f43c-4103-844e-eb5496a8a7f9","Type":"ContainerStarted","Data":"f23fd34bddcef5ea0e803616012640e362592fc82a051771fedd8db2d1b2c027"} Jul 28 18:01:31.483710 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.483687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbhfz" event={"ID":"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3","Type":"ContainerStarted","Data":"808a01c4dbc9c515dce0dd436e41f4d58f9fa8ba501f0b5f9787ac7594172c7d"} Jul 28 18:01:31.485580 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.485547 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" event={"ID":"64cd9c6e-b6be-49ac-82e1-87a9cae24756","Type":"ContainerStarted","Data":"4c5798da1d3e9b5cc518ba7a66ccf781e9b876429d1d01585a18c40499c5da65"} Jul 28 18:01:31.485685 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.485607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" event={"ID":"64cd9c6e-b6be-49ac-82e1-87a9cae24756","Type":"ContainerStarted","Data":"e2293998e0c4c60d5e3642e9289d66cd150d56d7e0d7edc44f0d837909d0286b"} Jul 28 18:01:31.485685 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.485637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" event={"ID":"64cd9c6e-b6be-49ac-82e1-87a9cae24756","Type":"ContainerStarted","Data":"42e52f190ed151918cd0451e4a6d72576e9294a80d14bf63ff0c84b6de5e7b2c"} Jul 28 18:01:31.508760 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.508706 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8dslv" podStartSLOduration=33.703057124 podStartE2EDuration="45.508686259s" totalImagesPullingTime="11.805629135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:00:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:31.507943393 +0000 UTC m=+91.019011296" watchObservedRunningTime="2026-07-28 18:01:31.508686259 +0000 UTC m=+91.019754165" Jul 28 18:01:31.529818 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.529780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc78g\" (UniqueName: \"kubernetes.io/projected/827b3569-8074-47c3-8745-4d3f65acb89e-kube-api-access-fc78g\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.529996 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.529845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-grpc-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.529996 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.529955 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.530098 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.530003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.530098 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.530043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.530098 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.530068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b3569-8074-47c3-8745-4d3f65acb89e-metrics-client-ca\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.530098 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.530093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.530244 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.530121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.630782 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.630968 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.630968 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.630968 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b3569-8074-47c3-8745-4d3f65acb89e-metrics-client-ca\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.630968 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.631181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.630975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.631181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.631009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc78g\" (UniqueName: \"kubernetes.io/projected/827b3569-8074-47c3-8745-4d3f65acb89e-kube-api-access-fc78g\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.631181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.631068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-grpc-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.632446 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.632417 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b3569-8074-47c3-8745-4d3f65acb89e-metrics-client-ca\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634020 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.633994 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634623 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.634196 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634623 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.634584 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634778 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.634758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634832 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.634775 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-grpc-tls\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.634832 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.634818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/827b3569-8074-47c3-8745-4d3f65acb89e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.641632 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.641610 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc78g\" (UniqueName: \"kubernetes.io/projected/827b3569-8074-47c3-8745-4d3f65acb89e-kube-api-access-fc78g\") pod \"thanos-querier-5488d564b7-2xv2c\" (UID: \"827b3569-8074-47c3-8745-4d3f65acb89e\") " pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.738651 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.738623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:31.895974 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:31.895857 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5488d564b7-2xv2c"] Jul 28 18:01:31.920991 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:31.920956 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827b3569_8074_47c3_8745_4d3f65acb89e.slice/crio-86cf819130aca9f39431c97d4fbedbb583aa016989a2030873222c8f9936e312 WatchSource:0}: Error finding container 86cf819130aca9f39431c97d4fbedbb583aa016989a2030873222c8f9936e312: Status 404 returned error can't find the container with id 86cf819130aca9f39431c97d4fbedbb583aa016989a2030873222c8f9936e312 Jul 28 18:01:32.439978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.439942 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:32.491236 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.491153 2561 generic.go:356] "Generic (PLEG): container finished" podID="a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3" containerID="936c9a765a8469079d8677305fc4aa22540849e6d6caa383406bd55c22aa9c11" exitCode=0 Jul 28 18:01:32.491388 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.491247 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbhfz" event={"ID":"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3","Type":"ContainerDied","Data":"936c9a765a8469079d8677305fc4aa22540849e6d6caa383406bd55c22aa9c11"} Jul 28 18:01:32.493700 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.493673 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" event={"ID":"64cd9c6e-b6be-49ac-82e1-87a9cae24756","Type":"ContainerStarted","Data":"fc934e982c406e487756913f73e8a11c340549f8b4723f1f74f717a8515ca5d4"} Jul 28 18:01:32.495121 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.495102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"86cf819130aca9f39431c97d4fbedbb583aa016989a2030873222c8f9936e312"} Jul 28 18:01:32.538240 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.538213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:32.551153 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.551111 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bzp46" podStartSLOduration=2.422410283 podStartE2EDuration="3.551095366s" totalImagesPullingTime="1.128685083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:32.55015657 +0000 UTC m=+92.061224474" watchObservedRunningTime="2026-07-28 18:01:32.551095366 +0000 UTC m=+92.062163270" Jul 28 18:01:32.870595 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.870513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:32.994782 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:32.994746 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:33.502616 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:33.502574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbhfz" event={"ID":"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3","Type":"ContainerStarted","Data":"b8547b64bbfa368e48405dc2892291cbe1355420303e69e49ce72783db1404ba"} Jul 28 18:01:33.503070 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:33.502679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hbhfz" event={"ID":"a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3","Type":"ContainerStarted","Data":"b1f31704ef3b03532d338776e10a2660541a7c4376a650a3db6125b65c1226a5"} Jul 28 18:01:33.525678 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:33.525560 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hbhfz" podStartSLOduration=3.596356401 podStartE2EDuration="4.525539042s" totalImagesPullingTime="825.059821ms" totalInitContainerRuntime="104.12282ms" isStatefulPod=true podCreationTimestamp="2026-07-28 18:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:33.52512826 +0000 UTC m=+93.036196167" watchObservedRunningTime="2026-07-28 18:01:33.525539042 +0000 UTC m=+93.036606941" Jul 28 18:01:34.174588 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.174562 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb"] Jul 28 18:01:34.177344 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.177322 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.182724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.182700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rmgzm\"" Jul 28 18:01:34.182993 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.182977 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 18:01:34.188748 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.188727 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb"] Jul 28 18:01:34.281794 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.281712 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:34.355121 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.355081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frfk7\" (UniqueName: \"kubernetes.io/projected/03f83490-a0e7-4d8d-9a60-d5651317a5c2-kube-api-access-frfk7\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.355277 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.355144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.455617 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.455575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.455769 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.455646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frfk7\" (UniqueName: \"kubernetes.io/projected/03f83490-a0e7-4d8d-9a60-d5651317a5c2-kube-api-access-frfk7\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.455769 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:34.455736 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 18:01:34.455835 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:01:34.455802 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert podName:03f83490-a0e7-4d8d-9a60-d5651317a5c2 nodeName:}" failed. No retries permitted until 2026-07-28 18:01:34.955781969 +0000 UTC m=+94.466849874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-9blsb" (UID: "03f83490-a0e7-4d8d-9a60-d5651317a5c2") : secret "monitoring-plugin-cert" not found Jul 28 18:01:34.465250 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.465220 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frfk7\" (UniqueName: \"kubernetes.io/projected/03f83490-a0e7-4d8d-9a60-d5651317a5c2-kube-api-access-frfk7\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.491981 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.491947 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:34.508691 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.508663 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"1010dc35c2bcbf82e76b42b0bf272aad2eaa3934fea7e8e11853043291f524b3"} Jul 28 18:01:34.509060 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.508728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"933b5810db45720c12f51ee7b4812c12dd9128c5f991e05ab5ff91c3a29168b5"} Jul 28 18:01:34.509060 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.508755 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"24ffe4fd7c4932d6cd777f4362b1f6bc249827f08632d992bbf09decdf7c2f90"} Jul 28 18:01:34.594337 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.594236 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:34.693756 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.693717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:34.960736 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.960709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:34.963295 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:34.963271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/03f83490-a0e7-4d8d-9a60-d5651317a5c2-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-9blsb\" (UID: \"03f83490-a0e7-4d8d-9a60-d5651317a5c2\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:35.087535 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.087512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:35.228293 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.228217 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb"] Jul 28 18:01:35.230993 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:35.230966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f83490_a0e7_4d8d_9a60_d5651317a5c2.slice/crio-2382712d1aa356bec071df56be21a2373793152d6a833c576f3b38d98386ca81 WatchSource:0}: Error finding container 2382712d1aa356bec071df56be21a2373793152d6a833c576f3b38d98386ca81: Status 404 returned error can't find the container with id 2382712d1aa356bec071df56be21a2373793152d6a833c576f3b38d98386ca81 Jul 28 18:01:35.407978 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.407952 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc4f88865-68tzp" Jul 28 18:01:35.514274 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.514239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" event={"ID":"03f83490-a0e7-4d8d-9a60-d5651317a5c2","Type":"ContainerStarted","Data":"2382712d1aa356bec071df56be21a2373793152d6a833c576f3b38d98386ca81"} Jul 28 18:01:35.517515 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.517479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"7f18dc68106078f2411aedeeb3254fb4c41669ceb96756c8d741e4a790a88cd1"} Jul 28 18:01:35.517628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.517543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"7e599710300749e1ef60d0f026394b6bfbb5dfd5ded3b01235873c7b7edb3ee3"} Jul 28 18:01:35.517628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.517570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" event={"ID":"827b3569-8074-47c3-8745-4d3f65acb89e","Type":"ContainerStarted","Data":"596e44b5f0f489119727a5f0706aa1ec32dbe9373f944037806e8980b9faeb1c"} Jul 28 18:01:35.517628 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.517622 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:35.546343 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.546299 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" podStartSLOduration=1.708846217 podStartE2EDuration="4.546284266s" totalImagesPullingTime="2.837438049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:35.545071989 +0000 UTC m=+95.056139894" watchObservedRunningTime="2026-07-28 18:01:35.546284266 +0000 UTC m=+95.057352196" Jul 28 18:01:35.637072 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.637045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:35.735589 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.735558 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:35.830013 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:35.829933 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:37.526660 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:37.526626 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" event={"ID":"03f83490-a0e7-4d8d-9a60-d5651317a5c2","Type":"ContainerStarted","Data":"3879043079ef45c92e36309c89164e0df281d6c9643ee4ccc75428a76fc09a64"} Jul 28 18:01:37.527082 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:37.526859 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:37.531841 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:37.531820 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" Jul 28 18:01:37.548281 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:37.548235 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-9blsb" podStartSLOduration=2.167039654 podStartE2EDuration="3.548219417s" totalImagesPullingTime="1.381179763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:37.546371945 +0000 UTC m=+97.057439848" watchObservedRunningTime="2026-07-28 18:01:37.548219417 +0000 UTC m=+97.059287323" Jul 28 18:01:38.104155 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:38.104123 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:38.204405 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:38.204369 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:38.279690 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:38.279654 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:39.123310 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.123277 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-24wqn"] Jul 28 18:01:39.125693 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.125678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:39.127715 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.127694 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 18:01:39.127920 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.127894 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8gb2z\"" Jul 28 18:01:39.128179 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.128163 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 18:01:39.138363 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.138339 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-24wqn"] Jul 28 18:01:39.166238 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.166197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:39.241563 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.241518 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:39.297835 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.297791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqp6j\" (UniqueName: \"kubernetes.io/projected/1cc62e36-871c-4675-867c-67b69bb19129-kube-api-access-lqp6j\") pod \"downloads-7c97dc4555-24wqn\" (UID: \"1cc62e36-871c-4675-867c-67b69bb19129\") " pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:39.398481 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.398391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqp6j\" (UniqueName: \"kubernetes.io/projected/1cc62e36-871c-4675-867c-67b69bb19129-kube-api-access-lqp6j\") pod \"downloads-7c97dc4555-24wqn\" (UID: \"1cc62e36-871c-4675-867c-67b69bb19129\") " pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:39.408041 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.408011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqp6j\" (UniqueName: \"kubernetes.io/projected/1cc62e36-871c-4675-867c-67b69bb19129-kube-api-access-lqp6j\") pod \"downloads-7c97dc4555-24wqn\" (UID: \"1cc62e36-871c-4675-867c-67b69bb19129\") " pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:39.420313 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.420283 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:39.435028 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.435000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:39.567710 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.567687 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-24wqn"] Jul 28 18:01:39.570273 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:39.570246 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc62e36_871c_4675_867c_67b69bb19129.slice/crio-29481aa433b3eaaa50aa247e34a78dd577938265d244f10a9e9bd445d84414fe WatchSource:0}: Error finding container 29481aa433b3eaaa50aa247e34a78dd577938265d244f10a9e9bd445d84414fe: Status 404 returned error can't find the container with id 29481aa433b3eaaa50aa247e34a78dd577938265d244f10a9e9bd445d84414fe Jul 28 18:01:39.806183 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:39.806112 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:40.227563 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:40.227477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:40.295396 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:40.295355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:40.431139 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:40.431103 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:40.530011 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:40.529967 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:40.541389 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:40.541354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-24wqn" event={"ID":"1cc62e36-871c-4675-867c-67b69bb19129","Type":"ContainerStarted","Data":"29481aa433b3eaaa50aa247e34a78dd577938265d244f10a9e9bd445d84414fe"} Jul 28 18:01:41.055171 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:41.055135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:41.212108 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:41.212070 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:41.380270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:41.380186 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:41.529415 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:41.529389 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5488d564b7-2xv2c" Jul 28 18:01:42.431677 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:42.431640 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:42.531887 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:42.531842 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:43.219019 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:43.218992 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:43.317101 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:43.317055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:44.177682 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:44.177631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:44.257345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:44.257294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:45.140312 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:45.140280 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:45.259217 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:45.259182 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:45.406927 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:45.406836 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k9bnn" Jul 28 18:01:48.249983 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.249945 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:01:48.257181 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.257156 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.260671 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.260646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kjvh6\"" Jul 28 18:01:48.260951 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.260931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 18:01:48.261042 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.260961 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 18:01:48.261640 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.261618 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 18:01:48.261749 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.261733 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 18:01:48.261816 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.261752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 18:01:48.268274 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.268253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:01:48.270569 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.270665 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.270665 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjgt\" (UniqueName: \"kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.270665 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.270790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.270790 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.270722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.371738 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.371693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.371738 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.371738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372015 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.371763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjgt\" (UniqueName: \"kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372015 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.371786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372015 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.371827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372166 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.372107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.372499 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372523 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.372519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.372805 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.372785 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.374780 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.374758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.374780 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.374776 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.381405 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.381380 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjgt\" (UniqueName: \"kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt\") pod \"console-5478fc89df-q2thg\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.570180 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.570088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:01:48.723319 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:48.723290 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:01:48.725580 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:48.725543 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21720e87_1a12_4b35_a86c_c22d63011ea9.slice/crio-c2ed58f71cf7194f0e23f153c487f83389449bbf831b0f190cbfc0767d582c5c WatchSource:0}: Error finding container c2ed58f71cf7194f0e23f153c487f83389449bbf831b0f190cbfc0767d582c5c: Status 404 returned error can't find the container with id c2ed58f71cf7194f0e23f153c487f83389449bbf831b0f190cbfc0767d582c5c Jul 28 18:01:49.583139 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:49.583101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5478fc89df-q2thg" event={"ID":"21720e87-1a12-4b35-a86c-c22d63011ea9","Type":"ContainerStarted","Data":"c2ed58f71cf7194f0e23f153c487f83389449bbf831b0f190cbfc0767d582c5c"} Jul 28 18:01:53.972255 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:53.972221 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:54.073105 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.072957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:54.825780 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.825738 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:01:54.856025 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.855988 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:01:54.856202 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.856096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.864888 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.864452 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 18:01:54.932887 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.932833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933086 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.932909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933086 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.932940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933086 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.932965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktz9\" (UniqueName: \"kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933086 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.933051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933240 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.933144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:54.933240 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:54.933176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lktz9\" (UniqueName: \"kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.034766 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.034565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.035197 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.035135 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.035197 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.035137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.035364 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.035322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.035798 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.035657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.037610 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.037587 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.037795 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.037771 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.045494 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.045467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktz9\" (UniqueName: \"kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9\") pod \"console-886bb57c5-bp9rn\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.167472 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.167380 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:01:55.566286 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.566250 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:55.626375 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:55.626326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:56.368077 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:56.368048 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:01:56.370813 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:01:56.370785 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19af46b8_ac05_48de_8e2a_45287739da3c.slice/crio-3b80fa4aa659f94cc158a6463b48c2eedfa51ef9ff444ce40a0ac9a413adcc28 WatchSource:0}: Error finding container 3b80fa4aa659f94cc158a6463b48c2eedfa51ef9ff444ce40a0ac9a413adcc28: Status 404 returned error can't find the container with id 3b80fa4aa659f94cc158a6463b48c2eedfa51ef9ff444ce40a0ac9a413adcc28 Jul 28 18:01:56.613316 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:56.613279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886bb57c5-bp9rn" event={"ID":"19af46b8-ac05-48de-8e2a-45287739da3c","Type":"ContainerStarted","Data":"3b80fa4aa659f94cc158a6463b48c2eedfa51ef9ff444ce40a0ac9a413adcc28"} Jul 28 18:01:57.623934 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:57.623033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-24wqn" event={"ID":"1cc62e36-871c-4675-867c-67b69bb19129","Type":"ContainerStarted","Data":"5991681a48bbca1988f8c7bc1f9d73784bcbf04ca2c6ce4c9f958882b762823d"} Jul 28 18:01:57.624699 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:57.624547 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:57.632225 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:57.632191 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-24wqn" Jul 28 18:01:57.646280 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:57.646086 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-24wqn" podStartSLOduration=1.636670495 podStartE2EDuration="18.646062696s" totalImagesPullingTime="17.009392201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:01:57.643562275 +0000 UTC m=+117.154630180" watchObservedRunningTime="2026-07-28 18:01:57.646062696 +0000 UTC m=+117.157130601" Jul 28 18:01:58.179287 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:58.179247 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:58.264517 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:58.264479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:01:59.436335 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:01:59.436297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.241245 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.241210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.341178 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.341138 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:01.646230 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.646159 2561 generic.go:356] "Generic (PLEG): container finished" podID="ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9" containerID="440e38424098c3102c978d6b398eac348c4aecf296c10908251d4d0680e83d65" exitCode=0 Jul 28 18:02:01.646395 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.646244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" event={"ID":"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9","Type":"ContainerDied","Data":"440e38424098c3102c978d6b398eac348c4aecf296c10908251d4d0680e83d65"} Jul 28 18:02:01.646703 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.646683 2561 scope.go:117] "RemoveContainer" containerID="440e38424098c3102c978d6b398eac348c4aecf296c10908251d4d0680e83d65" Jul 28 18:02:01.648382 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.648352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886bb57c5-bp9rn" event={"ID":"19af46b8-ac05-48de-8e2a-45287739da3c","Type":"ContainerStarted","Data":"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479"} Jul 28 18:02:01.650416 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.650392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5478fc89df-q2thg" event={"ID":"21720e87-1a12-4b35-a86c-c22d63011ea9","Type":"ContainerStarted","Data":"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3"} Jul 28 18:02:01.697099 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:01.697042 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-886bb57c5-bp9rn" podStartSLOduration=3.581170488 podStartE2EDuration="7.697023896s" totalImagesPullingTime="4.115853408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:01.694683172 +0000 UTC m=+121.205751076" watchObservedRunningTime="2026-07-28 18:02:01.697023896 +0000 UTC m=+121.208091798" Jul 28 18:02:02.657966 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:02.657928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-lhsj2" event={"ID":"ce5e3dd6-91d4-4b8c-970c-e85d3ab8a5e9","Type":"ContainerStarted","Data":"14bf90656df67bd9decfda9c8e0021a0a145356209d53e859f7781f3042a3b45"} Jul 28 18:02:02.682959 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:02.682902 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5478fc89df-q2thg" podStartSLOduration=2.779450132 podStartE2EDuration="14.682881309s" totalImagesPullingTime="11.903431177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:01.719098156 +0000 UTC m=+121.230166063" watchObservedRunningTime="2026-07-28 18:02:02.682881309 +0000 UTC m=+122.193949206" Jul 28 18:02:05.167863 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.167819 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:02:05.168316 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.167923 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:02:05.173470 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.173445 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:02:05.676186 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.676154 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:02:05.730114 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.730072 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:02:05.857397 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.857360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:05.957992 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:05.957919 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:06.058515 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:06.058479 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:08.570309 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:08.570275 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:02:11.699359 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:11.699324 2561 generic.go:356] "Generic (PLEG): container finished" podID="c263e0f3-02ae-414c-9d1b-83c2987b1f31" containerID="09a0dca160184525b8fc5a136ff835f46e9c987eafb75e923bfa7e26dc71a2b7" exitCode=0 Jul 28 18:02:11.699899 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:11.699405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" event={"ID":"c263e0f3-02ae-414c-9d1b-83c2987b1f31","Type":"ContainerDied","Data":"09a0dca160184525b8fc5a136ff835f46e9c987eafb75e923bfa7e26dc71a2b7"} Jul 28 18:02:11.699899 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:11.699840 2561 scope.go:117] "RemoveContainer" containerID="09a0dca160184525b8fc5a136ff835f46e9c987eafb75e923bfa7e26dc71a2b7" Jul 28 18:02:12.705425 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:12.705391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8q6rh" event={"ID":"c263e0f3-02ae-414c-9d1b-83c2987b1f31","Type":"ContainerStarted","Data":"81a391cfdc7ce9d323453f52f392d7122a3588c4144ab66b22e9e3af9443e8ec"} Jul 28 18:02:13.171994 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:13.171964 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:13.243381 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:13.243352 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:16.722642 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:16.722561 2561 generic.go:356] "Generic (PLEG): container finished" podID="3bc4c786-d3f1-4d64-b725-149e1990ce7d" containerID="fe49aa50cce2f476127c92e357388053bb6789db4f763161798c020b90e977d6" exitCode=0 Jul 28 18:02:16.723085 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:16.722641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" event={"ID":"3bc4c786-d3f1-4d64-b725-149e1990ce7d","Type":"ContainerDied","Data":"fe49aa50cce2f476127c92e357388053bb6789db4f763161798c020b90e977d6"} Jul 28 18:02:16.723134 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:16.723088 2561 scope.go:117] "RemoveContainer" containerID="fe49aa50cce2f476127c92e357388053bb6789db4f763161798c020b90e977d6" Jul 28 18:02:17.728635 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:17.728599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58" event={"ID":"3bc4c786-d3f1-4d64-b725-149e1990ce7d","Type":"ContainerStarted","Data":"eef642064814a205faa297c9e3e1ebdc02d385dfd582c300c72b84e5b84ed306"} Jul 28 18:02:28.983352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:28.983317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:29.085080 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:29.085039 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:30.753694 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:30.753637 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5478fc89df-q2thg" podUID="21720e87-1a12-4b35-a86c-c22d63011ea9" containerName="console" containerID="cri-o://f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3" gracePeriod=15 Jul 28 18:02:31.042061 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.042038 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:02:31.050636 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050616 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.050714 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050666 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.050714 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050695 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.050784 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050736 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldjgt\" (UniqueName: \"kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.050784 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050754 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.050895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.050787 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca\") pod \"21720e87-1a12-4b35-a86c-c22d63011ea9\" (UID: \"21720e87-1a12-4b35-a86c-c22d63011ea9\") " Jul 28 18:02:31.051575 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.051499 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config" (OuterVolumeSpecName: "console-config") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:31.051575 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.051526 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:31.051744 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.051574 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca" (OuterVolumeSpecName: "service-ca") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:02:31.058111 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.057956 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:31.058229 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.057968 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt" (OuterVolumeSpecName: "kube-api-access-ldjgt") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "kube-api-access-ldjgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:02:31.058229 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.058222 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "21720e87-1a12-4b35-a86c-c22d63011ea9" (UID: "21720e87-1a12-4b35-a86c-c22d63011ea9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:02:31.152037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152005 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.152037 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152031 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.152212 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152061 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.152212 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152071 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldjgt\" (UniqueName: \"kubernetes.io/projected/21720e87-1a12-4b35-a86c-c22d63011ea9-kube-api-access-ldjgt\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.152212 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152080 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21720e87-1a12-4b35-a86c-c22d63011ea9-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.152212 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.152088 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21720e87-1a12-4b35-a86c-c22d63011ea9-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:02:31.786500 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.786468 2561 generic.go:356] "Generic (PLEG): container finished" podID="21720e87-1a12-4b35-a86c-c22d63011ea9" containerID="f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3" exitCode=0 Jul 28 18:02:31.786935 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.786526 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5478fc89df-q2thg" Jul 28 18:02:31.786935 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.786555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5478fc89df-q2thg" event={"ID":"21720e87-1a12-4b35-a86c-c22d63011ea9","Type":"ContainerDied","Data":"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3"} Jul 28 18:02:31.786935 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.786632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5478fc89df-q2thg" event={"ID":"21720e87-1a12-4b35-a86c-c22d63011ea9","Type":"ContainerDied","Data":"c2ed58f71cf7194f0e23f153c487f83389449bbf831b0f190cbfc0767d582c5c"} Jul 28 18:02:31.786935 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.786653 2561 scope.go:117] "RemoveContainer" containerID="f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3" Jul 28 18:02:31.795511 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.795492 2561 scope.go:117] "RemoveContainer" containerID="f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3" Jul 28 18:02:31.795781 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:02:31.795762 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3\": container with ID starting with f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3 not found: ID does not exist" containerID="f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3" Jul 28 18:02:31.795889 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.795789 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3"} err="failed to get container status \"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3\": rpc error: code = NotFound desc = could not find container \"f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3\": container with ID starting with f13ec6b5b88f8d51eee40d7c14acef271072858805cf902f9dc35e34ba2aafb3 not found: ID does not exist" Jul 28 18:02:31.809366 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.809344 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:02:31.814578 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:31.814558 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5478fc89df-q2thg"] Jul 28 18:02:33.026818 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:33.026780 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21720e87-1a12-4b35-a86c-c22d63011ea9" path="/var/lib/kubelet/pods/21720e87-1a12-4b35-a86c-c22d63011ea9/volumes" Jul 28 18:02:40.910532 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:40.910490 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:48.831257 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:48.831217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:49.353279 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:49.353247 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:58.686310 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.686237 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:02:58.686639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.686540 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21720e87-1a12-4b35-a86c-c22d63011ea9" containerName="console" Jul 28 18:02:58.686639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.686550 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="21720e87-1a12-4b35-a86c-c22d63011ea9" containerName="console" Jul 28 18:02:58.686639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.686603 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="21720e87-1a12-4b35-a86c-c22d63011ea9" containerName="console" Jul 28 18:02:58.688528 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.688512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.702634 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.702607 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:02:58.751291 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.751264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:58.778398 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778511 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778511 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4wh\" (UniqueName: \"kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778511 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778623 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778623 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.778623 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.778591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.879668 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879642 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.879799 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.879799 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4wh\" (UniqueName: \"kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.879799 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.879799 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880017 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880017 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.879843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880454 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.880431 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880663 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.880646 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880814 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.880791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.880929 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.880908 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.882344 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.882326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.882571 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.882550 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.888527 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.888505 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4wh\" (UniqueName: \"kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh\") pod \"console-66d7f9c664-kdlv4\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:58.997615 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:58.997567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:02:59.132013 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:59.131802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:02:59.134730 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:02:59.134705 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d2b14a_154f_45f7_8c2f_edc210ca6f30.slice/crio-92aac92917a9d3a6953864a6b6c8d40d628a2c2d0de2311323e75170c84edcc0 WatchSource:0}: Error finding container 92aac92917a9d3a6953864a6b6c8d40d628a2c2d0de2311323e75170c84edcc0: Status 404 returned error can't find the container with id 92aac92917a9d3a6953864a6b6c8d40d628a2c2d0de2311323e75170c84edcc0 Jul 28 18:02:59.317895 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:59.317783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:02:59.907833 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:59.907791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d7f9c664-kdlv4" event={"ID":"d0d2b14a-154f-45f7-8c2f-edc210ca6f30","Type":"ContainerStarted","Data":"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90"} Jul 28 18:02:59.908270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:59.907846 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d7f9c664-kdlv4" event={"ID":"d0d2b14a-154f-45f7-8c2f-edc210ca6f30","Type":"ContainerStarted","Data":"92aac92917a9d3a6953864a6b6c8d40d628a2c2d0de2311323e75170c84edcc0"} Jul 28 18:02:59.927596 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:02:59.927552 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66d7f9c664-kdlv4" podStartSLOduration=1.927527462 podStartE2EDuration="1.927527462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:02:59.926327797 +0000 UTC m=+179.437395702" watchObservedRunningTime="2026-07-28 18:02:59.927527462 +0000 UTC m=+179.438595368" Jul 28 18:03:08.998710 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:08.998673 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:03:08.999132 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:08.998765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:03:09.003633 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:09.003612 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:03:09.947801 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:09.947773 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:03:10.001660 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:10.001629 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:03:10.111675 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:10.111643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:10.170393 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:10.170360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:11.131009 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:11.130974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:35.022054 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.021978 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-886bb57c5-bp9rn" podUID="19af46b8-ac05-48de-8e2a-45287739da3c" containerName="console" containerID="cri-o://8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479" gracePeriod=15 Jul 28 18:03:35.269960 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.269923 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:03:35.377858 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.377766 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.377858 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.377813 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.377858 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.377850 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.378167 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.377979 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.378167 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378045 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.378167 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378100 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.378167 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378133 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lktz9\" (UniqueName: \"kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9\") pod \"19af46b8-ac05-48de-8e2a-45287739da3c\" (UID: \"19af46b8-ac05-48de-8e2a-45287739da3c\") " Jul 28 18:03:35.378363 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378222 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca" (OuterVolumeSpecName: "service-ca") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:35.378363 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378338 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:35.378461 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378389 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config" (OuterVolumeSpecName: "console-config") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:35.378461 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378439 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.378550 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378457 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.378676 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.378653 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:03:35.380321 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.380296 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:35.380442 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.380424 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:03:35.380494 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.380436 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9" (OuterVolumeSpecName: "kube-api-access-lktz9") pod "19af46b8-ac05-48de-8e2a-45287739da3c" (UID: "19af46b8-ac05-48de-8e2a-45287739da3c"). InnerVolumeSpecName "kube-api-access-lktz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:03:35.479652 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.479616 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.479652 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.479649 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lktz9\" (UniqueName: \"kubernetes.io/projected/19af46b8-ac05-48de-8e2a-45287739da3c-kube-api-access-lktz9\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.479652 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.479661 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-trusted-ca-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.479929 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.479672 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19af46b8-ac05-48de-8e2a-45287739da3c-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:35.479929 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:35.479687 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19af46b8-ac05-48de-8e2a-45287739da3c-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:03:36.046583 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.046548 2561 generic.go:356] "Generic (PLEG): container finished" podID="19af46b8-ac05-48de-8e2a-45287739da3c" containerID="8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479" exitCode=0 Jul 28 18:03:36.047068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.046595 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-886bb57c5-bp9rn" Jul 28 18:03:36.047068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.046632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886bb57c5-bp9rn" event={"ID":"19af46b8-ac05-48de-8e2a-45287739da3c","Type":"ContainerDied","Data":"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479"} Jul 28 18:03:36.047068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.046680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-886bb57c5-bp9rn" event={"ID":"19af46b8-ac05-48de-8e2a-45287739da3c","Type":"ContainerDied","Data":"3b80fa4aa659f94cc158a6463b48c2eedfa51ef9ff444ce40a0ac9a413adcc28"} Jul 28 18:03:36.047068 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.046700 2561 scope.go:117] "RemoveContainer" containerID="8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479" Jul 28 18:03:36.056143 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.056128 2561 scope.go:117] "RemoveContainer" containerID="8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479" Jul 28 18:03:36.056396 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:03:36.056377 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479\": container with ID starting with 8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479 not found: ID does not exist" containerID="8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479" Jul 28 18:03:36.056447 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.056405 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479"} err="failed to get container status \"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479\": rpc error: code = NotFound desc = could not find container \"8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479\": container with ID starting with 8cc3aaac64b7551aa82df33497c0406ba5267994cf416ba2c4d68caa7de71479 not found: ID does not exist" Jul 28 18:03:36.072184 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.072157 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:03:36.076502 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:36.076478 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-886bb57c5-bp9rn"] Jul 28 18:03:37.027039 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:37.027008 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19af46b8-ac05-48de-8e2a-45287739da3c" path="/var/lib/kubelet/pods/19af46b8-ac05-48de-8e2a-45287739da3c/volumes" Jul 28 18:03:42.630621 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:42.630578 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:03:42.700826 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:03:42.700792 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:04.180935 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:04.180859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:04.241804 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:04.241764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:16.165797 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:16.165763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:16.230339 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:16.230305 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:22.076316 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:22.076242 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:27.321578 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.321547 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8df7d84d-svc2f"] Jul 28 18:04:27.322018 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.321852 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19af46b8-ac05-48de-8e2a-45287739da3c" containerName="console" Jul 28 18:04:27.322018 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.321862 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="19af46b8-ac05-48de-8e2a-45287739da3c" containerName="console" Jul 28 18:04:27.322018 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.321929 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="19af46b8-ac05-48de-8e2a-45287739da3c" containerName="console" Jul 28 18:04:27.324041 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.324025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.338450 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.338422 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8df7d84d-svc2f"] Jul 28 18:04:27.375716 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.375679 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:27.399147 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-trusted-ca-bundle\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399147 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-service-ca\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hd7m\" (UniqueName: \"kubernetes.io/projected/1c620fd3-13a7-4e2d-b035-5546ecfa1007-kube-api-access-4hd7m\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-oauth-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.399355 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.399284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-oauth-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500454 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-oauth-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500454 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-oauth-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-trusted-ca-bundle\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-service-ca\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hd7m\" (UniqueName: \"kubernetes.io/projected/1c620fd3-13a7-4e2d-b035-5546ecfa1007-kube-api-access-4hd7m\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.500961 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.500782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.501401 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.501301 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-oauth-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.501573 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.501556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-trusted-ca-bundle\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.501639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.501556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.501639 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.501591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1c620fd3-13a7-4e2d-b035-5546ecfa1007-service-ca\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.503196 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.503176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-oauth-config\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.503303 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.503199 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c620fd3-13a7-4e2d-b035-5546ecfa1007-console-serving-cert\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.510838 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.510817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hd7m\" (UniqueName: \"kubernetes.io/projected/1c620fd3-13a7-4e2d-b035-5546ecfa1007-kube-api-access-4hd7m\") pod \"console-8df7d84d-svc2f\" (UID: \"1c620fd3-13a7-4e2d-b035-5546ecfa1007\") " pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.633201 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.633114 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:27.767720 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.767685 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8df7d84d-svc2f"] Jul 28 18:04:27.770203 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:04:27.770170 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c620fd3_13a7_4e2d_b035_5546ecfa1007.slice/crio-a8e9c626053536bc36e52737c294a5cd54175c126979e2b939f2f5b03aa45b7e WatchSource:0}: Error finding container a8e9c626053536bc36e52737c294a5cd54175c126979e2b939f2f5b03aa45b7e: Status 404 returned error can't find the container with id a8e9c626053536bc36e52737c294a5cd54175c126979e2b939f2f5b03aa45b7e Jul 28 18:04:27.978943 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:27.978839 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:28.187188 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:28.187155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:28.244309 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:28.244272 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8df7d84d-svc2f" event={"ID":"1c620fd3-13a7-4e2d-b035-5546ecfa1007","Type":"ContainerStarted","Data":"ddf2f6006daa4ebf9b239a28492a13015f48b6fccfab00790b6760cb3f4f1482"} Jul 28 18:04:28.244479 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:28.244332 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8df7d84d-svc2f" event={"ID":"1c620fd3-13a7-4e2d-b035-5546ecfa1007","Type":"ContainerStarted","Data":"a8e9c626053536bc36e52737c294a5cd54175c126979e2b939f2f5b03aa45b7e"} Jul 28 18:04:28.266044 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:28.265981 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8df7d84d-svc2f" podStartSLOduration=1.26596142 podStartE2EDuration="1.26596142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:04:28.264277946 +0000 UTC m=+267.775345854" watchObservedRunningTime="2026-07-28 18:04:28.26596142 +0000 UTC m=+267.777029329" Jul 28 18:04:28.270937 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:28.270907 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:37.633404 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:37.633371 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:37.633767 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:37.633430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:37.638183 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:37.638160 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:38.285076 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:38.285044 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8df7d84d-svc2f" Jul 28 18:04:38.342925 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:38.342894 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:04:38.480694 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:38.480663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:38.576069 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:38.575950 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:38.654677 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:38.654646 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:48.164112 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:48.164078 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:04:48.244347 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:04:48.244317 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:00.908112 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:00.908084 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 18:05:03.362197 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.362133 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66d7f9c664-kdlv4" podUID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" containerName="console" containerID="cri-o://6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90" gracePeriod=15 Jul 28 18:05:03.605241 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.605217 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:05:03.708022 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.707929 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708022 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.707988 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708095 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708122 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v4wh\" (UniqueName: \"kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708144 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708221 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708192 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle\") pod \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\" (UID: \"d0d2b14a-154f-45f7-8c2f-edc210ca6f30\") " Jul 28 18:05:03.708593 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708479 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:05:03.708757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708733 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:05:03.708757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708633 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:05:03.708757 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.708658 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config" (OuterVolumeSpecName: "console-config") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 18:05:03.710317 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.710294 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:05:03.710398 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.710356 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 18:05:03.710398 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.710383 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh" (OuterVolumeSpecName: "kube-api-access-8v4wh") pod "d0d2b14a-154f-45f7-8c2f-edc210ca6f30" (UID: "d0d2b14a-154f-45f7-8c2f-edc210ca6f30"). InnerVolumeSpecName "kube-api-access-8v4wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 18:05:03.809218 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809183 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-oauth-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809218 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809210 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v4wh\" (UniqueName: \"kubernetes.io/projected/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-kube-api-access-8v4wh\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809218 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809221 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-oauth-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809218 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809230 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-trusted-ca-bundle\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809473 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809238 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-serving-cert\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809473 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809248 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-service-ca\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:03.809473 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:03.809256 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0d2b14a-154f-45f7-8c2f-edc210ca6f30-console-config\") on node \"ip-10-0-141-105.ec2.internal\" DevicePath \"\"" Jul 28 18:05:04.379608 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.379570 2561 generic.go:356] "Generic (PLEG): container finished" podID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" containerID="6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90" exitCode=0 Jul 28 18:05:04.379608 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.379608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d7f9c664-kdlv4" event={"ID":"d0d2b14a-154f-45f7-8c2f-edc210ca6f30","Type":"ContainerDied","Data":"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90"} Jul 28 18:05:04.380158 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.379622 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d7f9c664-kdlv4" Jul 28 18:05:04.380158 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.379642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d7f9c664-kdlv4" event={"ID":"d0d2b14a-154f-45f7-8c2f-edc210ca6f30","Type":"ContainerDied","Data":"92aac92917a9d3a6953864a6b6c8d40d628a2c2d0de2311323e75170c84edcc0"} Jul 28 18:05:04.380158 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.379660 2561 scope.go:117] "RemoveContainer" containerID="6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90" Jul 28 18:05:04.388047 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.388028 2561 scope.go:117] "RemoveContainer" containerID="6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90" Jul 28 18:05:04.388283 ip-10-0-141-105 kubenswrapper[2561]: E0728 18:05:04.388263 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90\": container with ID starting with 6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90 not found: ID does not exist" containerID="6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90" Jul 28 18:05:04.388345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.388290 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90"} err="failed to get container status \"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90\": rpc error: code = NotFound desc = could not find container \"6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90\": container with ID starting with 6506f08d6ce6f443ec978bac656502307b98a71b9e7eca657956178e20f77e90 not found: ID does not exist" Jul 28 18:05:04.406891 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.404685 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:05:04.409706 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:04.409685 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66d7f9c664-kdlv4"] Jul 28 18:05:05.027307 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:05.027272 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" path="/var/lib/kubelet/pods/d0d2b14a-154f-45f7-8c2f-edc210ca6f30/volumes" Jul 28 18:05:08.381994 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.381963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:08.529296 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.529259 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-28dk5/must-gather-dbkk8"] Jul 28 18:05:08.529591 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.529578 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" containerName="console" Jul 28 18:05:08.529638 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.529595 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" containerName="console" Jul 28 18:05:08.529700 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.529688 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d2b14a-154f-45f7-8c2f-edc210ca6f30" containerName="console" Jul 28 18:05:08.533170 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.533152 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.535352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.535332 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28dk5\"/\"openshift-service-ca.crt\"" Jul 28 18:05:08.535352 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.535345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-28dk5\"/\"default-dockercfg-zp4f9\"" Jul 28 18:05:08.535490 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.535407 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-28dk5\"/\"kube-root-ca.crt\"" Jul 28 18:05:08.542142 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.542122 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/must-gather-dbkk8"] Jul 28 18:05:08.649425 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.649332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-must-gather-output\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.649575 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.649476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbwbq\" (UniqueName: \"kubernetes.io/projected/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-kube-api-access-zbwbq\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.750547 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.750509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbwbq\" (UniqueName: \"kubernetes.io/projected/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-kube-api-access-zbwbq\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.750724 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.750571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-must-gather-output\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.750967 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.750949 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-must-gather-output\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.760693 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.760665 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbwbq\" (UniqueName: \"kubernetes.io/projected/a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60-kube-api-access-zbwbq\") pod \"must-gather-dbkk8\" (UID: \"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60\") " pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.848811 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.848765 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/must-gather-dbkk8" Jul 28 18:05:08.983526 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.983491 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/must-gather-dbkk8"] Jul 28 18:05:08.987095 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:05:08.987067 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda62ecb4c_cd5f_4a7e_9aba_8bf34cf05b60.slice/crio-724fb0ff01a9d3e081ebdecad698c7d19fc4875a2629fdb64f7d5a2902484d8d WatchSource:0}: Error finding container 724fb0ff01a9d3e081ebdecad698c7d19fc4875a2629fdb64f7d5a2902484d8d: Status 404 returned error can't find the container with id 724fb0ff01a9d3e081ebdecad698c7d19fc4875a2629fdb64f7d5a2902484d8d Jul 28 18:05:08.988922 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:08.988903 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 18:05:09.406498 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:09.406462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/must-gather-dbkk8" event={"ID":"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60","Type":"ContainerStarted","Data":"724fb0ff01a9d3e081ebdecad698c7d19fc4875a2629fdb64f7d5a2902484d8d"} Jul 28 18:05:09.604566 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:09.604529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:10.414413 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:10.414371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/must-gather-dbkk8" event={"ID":"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60","Type":"ContainerStarted","Data":"e0287fb608639be8c74b6df13fdfc76cb03f1c1a231f18e4704ad38ae67c3afa"} Jul 28 18:05:10.414413 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:10.414424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/must-gather-dbkk8" event={"ID":"a62ecb4c-cd5f-4a7e-9aba-8bf34cf05b60","Type":"ContainerStarted","Data":"74a9378f7d1ebfe8d5c38a1372689ee4ea4f0c0f96a79d8b1211b508118d0b28"} Jul 28 18:05:10.441223 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:10.441171 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-28dk5/must-gather-dbkk8" podStartSLOduration=1.731570557 podStartE2EDuration="2.441154135s" totalImagesPullingTime="709.583578ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:10.439594704 +0000 UTC m=+309.950662607" watchObservedRunningTime="2026-07-28 18:05:10.441154135 +0000 UTC m=+309.952222038" Jul 28 18:05:11.271522 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:11.271488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j6989_14750f95-880a-4f86-bc46-ff4a4bb6bc9a/global-pull-secret-syncer/0.log" Jul 28 18:05:11.377706 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:11.377672 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" Jul 28 18:05:11.527298 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:11.527229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-105.ec2.internal_518b8e3a950744810faae7969fae1c45/haproxy/0.log" Jul 28 18:05:14.392272 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:14.392233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:14.497039 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:14.496988 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-frknc_28ec8a8c-1aa3-4b2e-862a-e6640d0bf883/konnectivity-agent/0.log" limit=1024 Jul 28 18:05:15.490156 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:15.490122 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-d79g5_563f8985-56bb-4384-9d63-c2a797fd30c1/cluster-monitoring-operator/0.log" Jul 28 18:05:15.754197 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:15.754118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-9blsb_03f83490-a0e7-4d8d-9a60-d5651317a5c2/monitoring-plugin/0.log" Jul 28 18:05:16.039160 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.039074 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbhfz_a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3/node-exporter/0.log" Jul 28 18:05:16.075131 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.075103 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbhfz_a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3/kube-rbac-proxy/0.log" Jul 28 18:05:16.108239 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.108204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hbhfz_a3ebfbe8-997b-4b74-ba66-7caa2f4a64c3/init-textfile/0.log" Jul 28 18:05:16.144588 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.144559 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bzp46_64cd9c6e-b6be-49ac-82e1-87a9cae24756/kube-rbac-proxy-main/0.log" Jul 28 18:05:16.188249 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.188225 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bzp46_64cd9c6e-b6be-49ac-82e1-87a9cae24756/kube-rbac-proxy-self/0.log" Jul 28 18:05:16.227304 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:16.227238 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bzp46_64cd9c6e-b6be-49ac-82e1-87a9cae24756/openshift-state-metrics/0.log" Jul 28 18:05:17.146851 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.146817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/thanos-query/0.log" Jul 28 18:05:17.218251 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.218220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/kube-rbac-proxy-web/0.log" Jul 28 18:05:17.366434 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.366407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/kube-rbac-proxy/0.log" Jul 28 18:05:17.423738 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.423613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/prom-label-proxy/0.log" Jul 28 18:05:17.479204 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.479174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/kube-rbac-proxy-rules/0.log" Jul 28 18:05:17.541036 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:17.540997 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5488d564b7-2xv2c_827b3569-8074-47c3-8745-4d3f65acb89e/kube-rbac-proxy-metrics/0.log" Jul 28 18:05:18.260924 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.260890 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27"] Jul 28 18:05:18.266822 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.266797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.280762 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.280726 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27"] Jul 28 18:05:18.337501 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.337468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-sys\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.337501 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.337506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-lib-modules\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.337741 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.337528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-podres\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.337741 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.337550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-proc\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.337741 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.337582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mflbf\" (UniqueName: \"kubernetes.io/projected/83bee147-2f84-46c8-a9e5-804004864cc6-kube-api-access-mflbf\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.438889 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.438840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mflbf\" (UniqueName: \"kubernetes.io/projected/83bee147-2f84-46c8-a9e5-804004864cc6-kube-api-access-mflbf\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.438933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-sys\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.438957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-lib-modules\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.438977 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-podres\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.439053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-proc\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439103 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.439064 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-sys\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439376 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.439107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-lib-modules\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439376 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.439109 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-podres\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.439376 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.439168 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/83bee147-2f84-46c8-a9e5-804004864cc6-proc\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.449941 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.449913 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mflbf\" (UniqueName: \"kubernetes.io/projected/83bee147-2f84-46c8-a9e5-804004864cc6-kube-api-access-mflbf\") pod \"perf-node-gather-daemonset-stx27\" (UID: \"83bee147-2f84-46c8-a9e5-804004864cc6\") " pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.577131 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.577024 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:18.613113 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.613085 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-bbnrl_1d6df677-cdb8-4ee1-aa60-a14c992efdc9/networking-console-plugin/0.log" Jul 28 18:05:18.746656 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:18.746627 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27"] Jul 28 18:05:18.750461 ip-10-0-141-105 kubenswrapper[2561]: W0728 18:05:18.750422 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod83bee147_2f84_46c8_a9e5_804004864cc6.slice/crio-a6d358410515ee8306254c66d8734c2070c9ce4c18cc150da540d4b713589860 WatchSource:0}: Error finding container a6d358410515ee8306254c66d8734c2070c9ce4c18cc150da540d4b713589860: Status 404 returned error can't find the container with id a6d358410515ee8306254c66d8734c2070c9ce4c18cc150da540d4b713589860 Jul 28 18:05:19.466829 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:19.466792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" event={"ID":"83bee147-2f84-46c8-a9e5-804004864cc6","Type":"ContainerStarted","Data":"f4aed13e9ac2951155255c16db321dd15d1040ef9036743a806490f3effc0e75"} Jul 28 18:05:19.467259 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:19.466840 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" event={"ID":"83bee147-2f84-46c8-a9e5-804004864cc6","Type":"ContainerStarted","Data":"a6d358410515ee8306254c66d8734c2070c9ce4c18cc150da540d4b713589860"} Jul 28 18:05:19.467259 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:19.466902 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:19.661087 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:19.661057 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8df7d84d-svc2f_1c620fd3-13a7-4e2d-b035-5546ecfa1007/console/0.log" Jul 28 18:05:19.696424 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:19.696389 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-24wqn_1cc62e36-871c-4675-867c-67b69bb19129/download-server/0.log" Jul 28 18:05:20.222631 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:20.222264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-ql9gf_c040c207-26f7-4457-bbdb-c2c30a21ccd9/volume-data-source-validator/0.log" Jul 28 18:05:21.216791 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:21.216764 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qzgbc_ef6b27ec-2dd3-4176-b5b3-76a04d1acb50/dns/0.log" Jul 28 18:05:21.245191 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:21.245167 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qzgbc_ef6b27ec-2dd3-4176-b5b3-76a04d1acb50/kube-rbac-proxy/0.log" Jul 28 18:05:21.343842 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:21.343819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gm9g9_5bd23456-fc65-4e6b-bda9-6fbec26ffeb2/dns-node-resolver/0.log" Jul 28 18:05:21.919270 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:21.919238 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bc4f88865-68tzp_cd933b84-d859-4d74-9c35-83ac28a4d3f0/registry/0.log" Jul 28 18:05:21.953008 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:21.952984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bq5t7_eed9c43b-5736-49b0-9143-a2d4de9bf2fd/node-ca/0.log" Jul 28 18:05:23.381579 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:23.381554 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6skgf_eee2bfb3-3188-4dc4-b597-3cbc8e8704aa/serve-healthcheck-canary/0.log" Jul 28 18:05:23.919135 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:23.919093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8q6rh_c263e0f3-02ae-414c-9d1b-83c2987b1f31/insights-operator/1.log" Jul 28 18:05:23.919345 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:23.919326 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8q6rh_c263e0f3-02ae-414c-9d1b-83c2987b1f31/insights-operator/0.log" Jul 28 18:05:24.057005 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:24.056974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dslv_1faf6d5f-f43c-4103-844e-eb5496a8a7f9/kube-rbac-proxy/0.log" Jul 28 18:05:24.088779 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:24.088754 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dslv_1faf6d5f-f43c-4103-844e-eb5496a8a7f9/exporter/0.log" Jul 28 18:05:24.118920 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:24.118895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dslv_1faf6d5f-f43c-4103-844e-eb5496a8a7f9/extractor/0.log" Jul 28 18:05:25.481331 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:25.481303 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" Jul 28 18:05:25.510740 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:25.510686 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-28dk5/perf-node-gather-daemonset-stx27" podStartSLOduration=7.510672066 podStartE2EDuration="7.510672066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:05:19.491604165 +0000 UTC m=+319.002672069" watchObservedRunningTime="2026-07-28 18:05:25.510672066 +0000 UTC m=+325.021739969" Jul 28 18:05:29.941997 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:29.941917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58_3bc4c786-d3f1-4d64-b725-149e1990ce7d/kube-storage-version-migrator-operator/1.log" Jul 28 18:05:29.942827 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:29.942811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-8hv58_3bc4c786-d3f1-4d64-b725-149e1990ce7d/kube-storage-version-migrator-operator/0.log" Jul 28 18:05:31.097728 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.097698 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8pb9j_891c882b-1afa-44d2-9519-767eeebe12ed/kube-multus/0.log" Jul 28 18:05:31.601478 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.601449 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/kube-multus-additional-cni-plugins/0.log" Jul 28 18:05:31.636679 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.636631 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/egress-router-binary-copy/0.log" Jul 28 18:05:31.674381 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.674352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/cni-plugins/0.log" Jul 28 18:05:31.709962 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.709928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/bond-cni-plugin/0.log" Jul 28 18:05:31.739410 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.739384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/routeoverride-cni/0.log" Jul 28 18:05:31.770769 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.770740 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/whereabouts-cni-bincopy/0.log" Jul 28 18:05:31.801925 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.801898 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cwkwz_e450dd62-d3d7-463e-84cd-d3add06d7f0d/whereabouts-cni/0.log" Jul 28 18:05:31.876547 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.876474 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t46rm_b3eed24a-f3ce-4080-804e-a0707e54e551/network-metrics-daemon/0.log" Jul 28 18:05:31.911376 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:31.911348 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-t46rm_b3eed24a-f3ce-4080-804e-a0707e54e551/kube-rbac-proxy/0.log" Jul 28 18:05:33.563991 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.563959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/ovn-controller/0.log" Jul 28 18:05:33.612141 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.612099 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/ovn-acl-logging/0.log" Jul 28 18:05:33.665310 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.665283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/kube-rbac-proxy-node/0.log" Jul 28 18:05:33.712396 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.712367 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 18:05:33.763553 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.763528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/northd/0.log" Jul 28 18:05:33.816360 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.816292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/nbdb/0.log" Jul 28 18:05:33.872457 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.872430 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/sbdb/0.log" Jul 28 18:05:33.934604 ip-10-0-141-105 kubenswrapper[2561]: I0728 18:05:33.934569 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ncqt7_2353c788-59df-444a-a10f-2cb3c7c9f236/ovnkube-controller/0.log"