Jul 23 21:25:46.739053 ip-10-0-130-109 systemd[1]: Starting Kubernetes Kubelet... Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.156663 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160382 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160395 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160399 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160403 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160407 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160410 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.264709 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160419 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.246430 ip-10-0-130-109 systemd[1]: Started Kubernetes Kubelet. Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160423 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160426 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160429 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160432 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160435 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160438 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160441 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160444 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160447 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160450 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160453 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160455 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160459 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160462 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160464 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160467 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160470 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160473 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160476 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.267073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160479 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160482 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160485 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160488 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160491 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160494 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160496 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160499 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160502 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160505 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160507 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160510 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160513 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160516 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160518 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160521 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160524 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160527 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160530 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160534 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.270041 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160539 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160541 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160544 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160547 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160550 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160553 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160555 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160558 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160560 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160563 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160568 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160571 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160574 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160578 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160582 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160585 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160588 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160591 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160594 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160597 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.271121 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160599 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160602 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160605 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160612 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160615 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160619 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160621 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160624 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160627 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160630 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160633 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160635 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160638 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160641 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160643 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160646 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160649 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160652 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160654 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.272273 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160657 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160660 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160663 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160666 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160669 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160671 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160674 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160677 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160679 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160682 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160685 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160687 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160690 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.160693 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161442 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161449 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161452 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161461 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161464 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161467 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.273194 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161469 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161472 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161475 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161478 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161481 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161483 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161488 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161493 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161496 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161499 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161502 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161504 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161507 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161510 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161512 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161515 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161518 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161521 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161529 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.274496 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161532 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161535 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161538 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161541 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161543 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161546 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161549 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161552 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161556 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161560 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161563 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161573 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161576 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161579 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161583 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161586 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161589 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161591 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161594 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.275523 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161597 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161600 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161603 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161606 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161608 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161611 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161613 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161616 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161619 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161622 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161625 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161627 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161630 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161633 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161636 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161638 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161641 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161644 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161647 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161649 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.276369 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161652 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161655 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161660 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161663 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161671 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161675 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161680 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161683 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161686 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161689 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161691 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161694 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161697 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161699 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161702 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161704 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161707 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161710 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161712 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.277336 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161716 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161719 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161722 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161725 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161728 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161730 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161733 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161735 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161738 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161759 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161762 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161764 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161767 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161770 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.161774 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162194 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162198 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162201 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162205 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162208 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.280279 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162211 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162214 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162216 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162219 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162222 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162225 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162228 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162231 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162234 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162237 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162240 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162243 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162246 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162251 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162254 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162260 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162263 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162265 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162268 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.281612 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162271 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162274 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162277 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162279 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162282 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162285 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162288 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162290 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162293 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162296 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162299 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162303 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162306 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162311 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162314 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162317 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162320 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162323 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162326 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162329 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.282407 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162331 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162334 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162338 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162341 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162344 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162349 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162352 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162355 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162358 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162360 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162364 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162367 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162369 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162372 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162375 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162377 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162380 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162382 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162385 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162388 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.410740 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162391 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162394 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162396 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162399 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162402 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162405 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162408 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162410 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162413 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162416 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162418 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162421 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162423 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162427 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162432 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162436 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162439 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162443 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162446 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.427040 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162448 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162460 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162463 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162468 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162471 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162474 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162477 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162480 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162483 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162486 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162489 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162492 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162495 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162498 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.162501 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162569 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162576 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162592 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162602 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162608 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162613 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 21:25:47.428268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162618 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162623 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162626 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162630 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162633 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162637 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162641 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162645 2578 flags.go:64] FLAG: --cgroup-root="" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162648 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162653 2578 flags.go:64] FLAG: --client-ca-file="" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162656 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.162659 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163033 2578 flags.go:64] FLAG: --cluster-domain="" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163037 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163040 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163044 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163048 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163051 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163055 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163058 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163062 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163065 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163068 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163071 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 21:25:47.430384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163074 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163078 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163082 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163085 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163088 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163092 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163096 2578 flags.go:64] FLAG: --enable-server="true" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163099 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163103 2578 flags.go:64] FLAG: --event-burst="100" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163106 2578 flags.go:64] FLAG: --event-qps="50" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163109 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163112 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163115 2578 flags.go:64] FLAG: --eviction-hard="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163120 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163125 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163128 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163131 2578 flags.go:64] FLAG: --eviction-soft="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163136 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163139 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163142 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163145 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163148 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163151 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163154 2578 flags.go:64] FLAG: --feature-gates="" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163159 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 21:25:47.431502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163162 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163165 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163168 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163172 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163175 2578 flags.go:64] FLAG: --help="false" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163178 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163181 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163184 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163187 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163190 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163194 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163197 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163200 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163203 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163206 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163209 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163213 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163215 2578 flags.go:64] FLAG: --kube-reserved="" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163218 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163222 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163225 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163229 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163232 2578 flags.go:64] FLAG: --lock-file="" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163235 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 21:25:47.434665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163239 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163242 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163248 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163252 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163255 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163258 2578 flags.go:64] FLAG: --logging-format="text" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163261 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163264 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163267 2578 flags.go:64] FLAG: --manifest-url="" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163270 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163275 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163278 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163282 2578 flags.go:64] FLAG: --max-pods="110" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163285 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163288 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163291 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163294 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163297 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163301 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163304 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163311 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163314 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163318 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 21:25:47.435861 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163321 2578 flags.go:64] FLAG: --pod-cidr="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163324 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163329 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163332 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163335 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163339 2578 flags.go:64] FLAG: --port="10250" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163343 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163346 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08c92601db74c1305" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163349 2578 flags.go:64] FLAG: --qos-reserved="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163352 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163356 2578 flags.go:64] FLAG: --register-node="true" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163360 2578 flags.go:64] FLAG: --register-with-taints="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163363 2578 flags.go:64] FLAG: --registry-burst="10" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163367 2578 flags.go:64] FLAG: --registry-qps="5" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163370 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163373 2578 flags.go:64] FLAG: --reserved-memory="" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163377 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163380 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163384 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163386 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163389 2578 flags.go:64] FLAG: --runonce="false" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163393 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163396 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163399 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163402 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 21:25:47.438619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163405 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163408 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163411 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163415 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163418 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163420 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163423 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163427 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163430 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163433 2578 flags.go:64] FLAG: --system-cgroups="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163436 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163441 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163445 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163449 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163453 2578 flags.go:64] FLAG: --tls-min-version="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163456 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163459 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163463 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163466 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163469 2578 flags.go:64] FLAG: --v="2" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163473 2578 flags.go:64] FLAG: --version="false" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163477 2578 flags.go:64] FLAG: --vmodule="" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163481 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.163484 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163609 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.439793 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163613 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163616 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163619 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163622 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163625 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163628 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163631 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163634 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163637 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163682 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163687 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163691 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163695 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163699 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163703 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163707 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163717 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163721 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163724 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.625089 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163727 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163731 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163734 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163737 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163752 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163757 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163759 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163762 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163765 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163768 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163771 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163774 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163777 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163780 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163783 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163785 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163788 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163791 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163793 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163796 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.627096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163799 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163802 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163804 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163807 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163810 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163813 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163816 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163819 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163821 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163824 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163827 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163830 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163833 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163839 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163843 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163845 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163848 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163852 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163855 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.628294 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163858 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163861 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163864 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163866 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163869 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163872 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163874 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163877 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163879 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163882 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163885 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163887 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163890 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163892 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163895 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163898 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163900 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163903 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163906 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163908 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.630118 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163911 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163913 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163916 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163919 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163922 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163924 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163928 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163931 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163933 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163936 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163940 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163942 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163945 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163948 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163951 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163953 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163956 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163959 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163961 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.631067 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.163964 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.164735 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.179212 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.179236 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.179259 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.179265 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179330 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179335 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179339 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179342 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179345 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179348 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179351 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179354 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.632222 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179358 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179362 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179365 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179369 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179372 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179375 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179377 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179380 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179383 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179386 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179389 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179392 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179394 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179398 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179401 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179403 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179406 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179409 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179412 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179416 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.632929 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179419 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179422 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179425 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179427 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179430 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179435 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179439 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179442 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179445 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179449 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179451 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179455 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179458 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179461 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179463 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179466 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179469 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179472 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179474 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.634341 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179478 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179481 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179483 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179486 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179489 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179492 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179494 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179497 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179500 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179503 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179506 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179511 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179514 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179517 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179521 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179524 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179528 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179531 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179534 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.636199 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179537 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179540 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179543 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179545 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179548 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179551 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179553 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179556 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179562 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179564 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179567 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179570 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179574 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179576 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179579 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179582 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179584 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179587 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179590 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.637015 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179592 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179595 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179598 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179600 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179604 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179607 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179612 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179615 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179617 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179620 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179623 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179626 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179629 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.179634 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179787 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:25:47.637801 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179795 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179799 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179802 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179806 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179809 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179812 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179815 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179821 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179824 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179827 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179831 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179834 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179837 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179840 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179843 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179846 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179848 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179851 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179854 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:25:47.638426 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179857 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179861 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179864 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179867 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179871 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179873 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179876 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179879 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179882 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179884 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179887 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179890 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179893 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179896 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179899 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179903 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179907 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179910 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179913 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179916 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:25:47.639226 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179919 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179921 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179924 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179927 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179930 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179933 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179936 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179939 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179941 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179944 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179946 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179949 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179952 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179956 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179959 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179961 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179965 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179968 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179971 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179974 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:25:47.640033 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179976 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179979 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179982 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179984 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179987 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179990 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179993 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179995 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.179998 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180001 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180004 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180006 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180009 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180012 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180014 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180017 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180020 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180024 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180028 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180031 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:25:47.640855 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180034 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180037 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180040 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180043 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180045 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180050 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180052 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180055 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180059 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180062 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180065 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180067 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180070 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180073 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180076 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180079 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180081 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:25:47.641665 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:47.180084 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.180089 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.180232 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.182204 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.187692 2578 server.go:1019] "Starting client certificate rotation" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.187798 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.187831 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.190188 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.194906 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.211360 2578 log.go:25] "Validated CRI v1 runtime API" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.213782 2578 log.go:25] "Validated CRI v1 image API" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.214634 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 21:25:47.642359 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.218693 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:25:47.642867 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.221261 2578 fs.go:135] Filesystem UUIDs: map[452ced93-85ca-4aee-b805-02c5e9b74a62:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cf940352-1eec-4b23-9cef-f03b4af1b837:/dev/nvme0n1p4] Jul 23 21:25:47.642867 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.221276 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.226381 2578 manager.go:216] Machine: {Timestamp:2026-07-23 21:25:47.224956954 +0000 UTC m=+0.365145081 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102146 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d8fdde51bdb0975036377b24dbf96 SystemUUID:ec2d8fdd-e51b-db09-7503-6377b24dbf96 BootID:d6539389-f2ae-44f3-b373-4d07d64f20b1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:98:06:14:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:98:06:14:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:58:b0:58:80:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.226493 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.226610 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.229801 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.229827 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.231094 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.231106 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.231115 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.231135 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.232440 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235155 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235297 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235326 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235336 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235358 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235368 2578 kubelet.go:398] "Adding apiserver pod source" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235377 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 21:25:47.642964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235774 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.235789 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.238504 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.239881 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.239908 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240564 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240576 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240582 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240588 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240596 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240602 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240624 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240630 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240636 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240642 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240652 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.240659 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.242309 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.242321 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.245424 2578 server.go:1268] "Started kubelet" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.245552 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.245664 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.245961 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.247064 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.247312 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.247325 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.247451 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.257883 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.258512 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.261354 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dmjs9" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.263738 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-109.ec2.internal.18c5084b65c7262c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-109.ec2.internal,UID:ip-10-0-130-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-109.ec2.internal,},FirstTimestamp:2026-07-23 21:25:47.245389356 +0000 UTC m=+0.385577483,LastTimestamp:2026-07-23 21:25:47.245389356 +0000 UTC m=+0.385577483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-109.ec2.internal,}" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.269478 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dmjs9" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270030 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270035 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.270143 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270676 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270696 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270696 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270851 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.270859 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 23 21:25:47.643746 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271049 2578 factory.go:55] Registering systemd factory Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271063 2578 factory.go:223] Registration of the systemd container factory successfully Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271322 2578 factory.go:153] Registering CRI-O factory Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271348 2578 factory.go:223] Registration of the crio container factory successfully Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271412 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271436 2578 factory.go:103] Registering Raw factory Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271454 2578 manager.go:1196] Started watching for new ooms in manager Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.271858 2578 manager.go:349] Starting recovery of all containers Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.273682 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.273815 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.283015 2578 manager.go:354] Recovery completed Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.287947 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.290516 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.290571 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.290590 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.291635 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.291674 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.291686 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.291735 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292818 2578 policy_none.go:49] "None policy: Start" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292838 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292853 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292892 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292918 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.292932 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.293925 2578 policy_none.go:47] "Start" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333376 2578 manager.go:337] "Starting Device Plugin manager" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.333410 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333420 2578 server.go:87] "Starting device plugin registration server" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333733 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333759 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333865 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333985 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.333994 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.334577 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.334622 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.400442 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.401861 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.401905 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.401932 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.401973 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.404499 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.434688 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.436892 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.436922 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.436935 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.436961 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.645391 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.444949 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.444972 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-109.ec2.internal\": node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.472352 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.502786 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal"] Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.502858 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.504570 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.504600 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.504618 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.506086 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.506232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.506266 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.506978 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.507000 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.507011 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.507022 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.507047 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.507060 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.508262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.508288 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.509091 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.509121 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.509131 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.540689 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-109.ec2.internal\" not found" node="ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.545318 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-109.ec2.internal\" not found" node="ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.572137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.572163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.572181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8af94d40da9ac8160345a87ba6c1a1f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-109.ec2.internal\" (UID: \"c8af94d40da9ac8160345a87ba6c1a1f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.647337 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.573247 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.673102 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8af94d40da9ac8160345a87ba6c1a1f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-109.ec2.internal\" (UID: \"c8af94d40da9ac8160345a87ba6c1a1f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673239 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673239 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673239 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673376 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1073069d058afeea1cace0e31f40b482-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal\" (UID: \"1073069d058afeea1cace0e31f40b482\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673376 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.673199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8af94d40da9ac8160345a87ba6c1a1f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-109.ec2.internal\" (UID: \"c8af94d40da9ac8160345a87ba6c1a1f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.673376 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.673275 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.774328 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.774289 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.843001 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.842969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.849851 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:47.849822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:47.874716 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.874677 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:47.975441 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:47.975322 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:48.076450 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:48.076417 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:48.090018 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.089995 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:48.176765 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:48.176709 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-109.ec2.internal\" not found" Jul 23 21:25:48.183396 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.183372 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 21:25:48.183574 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.183553 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:25:48.183629 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.183568 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:25:48.270187 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.270105 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:48.271073 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.271053 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" Jul 23 21:25:48.271188 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.271059 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 21:25:48.275057 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.275031 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 21:20:48 +0000 UTC" deadline="2028-01-10 04:52:00.154480884 +0000 UTC" Jul 23 21:25:48.275138 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.275057 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12847h26m11.879426904s" Jul 23 21:25:48.280600 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.280574 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:25:48.281680 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.281666 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" Jul 23 21:25:48.284130 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.284114 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:25:48.293546 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.293532 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:25:48.306831 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.306807 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x95g9" Jul 23 21:25:48.314667 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.314647 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x95g9" Jul 23 21:25:48.473154 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:48.473112 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1073069d058afeea1cace0e31f40b482.slice/crio-b46d4431757faaf5f2d7d9902a5c703f375ed30c066da5cef04f359a25965838 WatchSource:0}: Error finding container b46d4431757faaf5f2d7d9902a5c703f375ed30c066da5cef04f359a25965838: Status 404 returned error can't find the container with id b46d4431757faaf5f2d7d9902a5c703f375ed30c066da5cef04f359a25965838 Jul 23 21:25:48.473417 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:48.473395 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8af94d40da9ac8160345a87ba6c1a1f.slice/crio-ddcb4744377593ba536d2c45161ed93533d740a10b75959e1699caeac80d65d9 WatchSource:0}: Error finding container ddcb4744377593ba536d2c45161ed93533d740a10b75959e1699caeac80d65d9: Status 404 returned error can't find the container with id ddcb4744377593ba536d2c45161ed93533d740a10b75959e1699caeac80d65d9 Jul 23 21:25:48.479562 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.479544 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:25:48.484960 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:48.484940 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:49.206368 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.206336 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:49.240070 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.240029 2578 apiserver.go:52] "Watching apiserver" Jul 23 21:25:49.252336 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.252307 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 21:25:49.254279 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.254254 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kpwv5","kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6ph65","openshift-multus/multus-2rvww","openshift-multus/multus-additional-cni-plugins-f8nbc","openshift-multus/network-metrics-daemon-jmbts","openshift-network-diagnostics/network-check-target-w2fgj","openshift-network-operator/iptables-alerter-dmlkt","kube-system/global-pull-secret-syncer-tfk45","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr","openshift-dns/node-resolver-tcpqb","openshift-image-registry/node-ca-vxndw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-nrfvl"] Jul 23 21:25:49.256436 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.256416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:49.256516 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.256496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:25:49.258072 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.258057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.259113 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.259096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.260266 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.260243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.260702 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.260681 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.260811 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.260721 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.260811 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.260762 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5kxb8\"" Jul 23 21:25:49.261445 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.261424 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.261584 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.261567 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.261584 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.261579 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s9qjd\"" Jul 23 21:25:49.261697 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.261620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.262814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.262794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.262948 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.262924 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:49.263086 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.263068 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.263214 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.263197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 21:25:49.263375 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.263357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.263653 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.263634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 21:25:49.263803 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.263784 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzpvs\"" Jul 23 21:25:49.264474 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.264454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.264559 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.264542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:49.264754 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.264739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 21:25:49.264940 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.264916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lt7pt\"" Jul 23 21:25:49.265785 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.265766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 21:25:49.266126 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.266103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.267435 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.267418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.268583 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.268564 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 21:25:49.268993 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.268967 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.268993 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.268966 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 21:25:49.269145 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.269012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.269145 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.269052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.269145 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.269114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 21:25:49.269145 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.268967 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v29xb\"" Jul 23 21:25:49.271333 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.271308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.271946 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.271540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.271946 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.271929 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-54t6f\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.272156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.272186 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.272647 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.273363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.273414 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.273941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.273504 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zm6m\"" Jul 23 21:25:49.274305 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.274127 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.275379 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.275034 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z46xs\"" Jul 23 21:25:49.275379 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.275071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.275379 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.275089 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 21:25:49.275379 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.275130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 21:25:49.277364 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.277347 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 21:25:49.277420 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.277370 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 21:25:49.277599 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.277586 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5j4qf\"" Jul 23 21:25:49.277670 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.277657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 21:25:49.284255 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3544c995-cd90-4090-b348-6199ea1e7c1a-hosts-file\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.284334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-k8s-cni-cncf-io\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-conf-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284305 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-multus-certs\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-var-lib-kubelet\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-bin\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-multus\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-etc-kubernetes\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtn4g\" (UniqueName: \"kubernetes.io/projected/fed8e59e-505d-4fb3-9988-f9474dd223d3-kube-api-access-vtn4g\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-kubernetes\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-netns\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284572 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-hostroot\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-systemd\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-script-lib\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-dbus\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-socket-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-device-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbsh2\" (UniqueName: \"kubernetes.io/projected/3544c995-cd90-4090-b348-6199ea1e7c1a-kube-api-access-sbsh2\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-modprobe-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.284885 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysconfig\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-env-overrides\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-systemd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.284972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-sys-fs\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-conf\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-netd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56876218-059f-4079-bd7e-d55cd95a4a11-ovn-node-metrics-cert\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285110 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nvrl\" (UniqueName: \"kubernetes.io/projected/56876218-059f-4079-bd7e-d55cd95a4a11-kube-api-access-8nvrl\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-system-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-kubelet-config\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-kubelet\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cnibin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-socket-dir-parent\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285310 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4a2940-4a7f-4876-9037-b065fdec7803-host\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-sys\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-var-lib-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-bin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-kubelet\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrkmx\" (UniqueName: \"kubernetes.io/projected/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-kube-api-access-vrkmx\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-system-cni-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-os-release\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9a931a5-9c6d-4ad5-bc01-f32248486449-konnectivity-ca\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285595 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3544c995-cd90-4090-b348-6199ea1e7c1a-tmp-dir\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsq8g\" (UniqueName: \"kubernetes.io/projected/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-kube-api-access-gsq8g\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.285814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-os-release\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-tmp\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-ovn\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-daemon-config\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-run\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plqdb\" (UniqueName: \"kubernetes.io/projected/c8f8793a-c74f-4715-9d3f-2515d8b98aab-kube-api-access-plqdb\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285940 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.285967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8fd7\" (UniqueName: \"kubernetes.io/projected/971ceb35-e0cc-4f35-81e6-d3f941c2421b-kube-api-access-z8fd7\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-config\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cni-binary-copy\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-host-slash\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-host\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286104 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cnibin\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8qw\" (UniqueName: \"kubernetes.io/projected/2ceace3b-3157-4d67-9f52-a05962f3fa4e-kube-api-access-hm8qw\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.286537 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-systemd-units\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-iptables-alerter-script\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9a931a5-9c6d-4ad5-bc01-f32248486449-agent-certs\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-lib-modules\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-log-socket\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-registration-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e4a2940-4a7f-4876-9037-b065fdec7803-serviceca\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbshs\" (UniqueName: \"kubernetes.io/projected/3e4a2940-4a7f-4876-9037-b065fdec7803-kube-api-access-jbshs\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-etc-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-node-log\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-tuned\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-slash\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.287430 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.286472 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-netns\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.316847 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.316815 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:20:49 +0000 UTC" deadline="2028-04-08 12:37:38.801737984 +0000 UTC" Jul 23 21:25:49.316929 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.316849 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14991h11m49.484893954s" Jul 23 21:25:49.372428 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.372398 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 21:25:49.386806 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.386806 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-bin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-kubelet\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-bin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrkmx\" (UniqueName: \"kubernetes.io/projected/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-kube-api-access-vrkmx\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-kubelet\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386942 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-system-cni-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386997 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-system-cni-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.387033 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.386997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-os-release\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9a931a5-9c6d-4ad5-bc01-f32248486449-konnectivity-ca\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-os-release\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3544c995-cd90-4090-b348-6199ea1e7c1a-tmp-dir\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsq8g\" (UniqueName: \"kubernetes.io/projected/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-kube-api-access-gsq8g\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-os-release\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-tmp\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-ovn\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-daemon-config\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-run\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plqdb\" (UniqueName: \"kubernetes.io/projected/c8f8793a-c74f-4715-9d3f-2515d8b98aab-kube-api-access-plqdb\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.387450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8fd7\" (UniqueName: \"kubernetes.io/projected/971ceb35-e0cc-4f35-81e6-d3f941c2421b-kube-api-access-z8fd7\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3544c995-cd90-4090-b348-6199ea1e7c1a-tmp-dir\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-config\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cni-binary-copy\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-host-slash\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-host\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cnibin\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8qw\" (UniqueName: \"kubernetes.io/projected/2ceace3b-3157-4d67-9f52-a05962f3fa4e-kube-api-access-hm8qw\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-systemd-units\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-iptables-alerter-script\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9a931a5-9c6d-4ad5-bc01-f32248486449-agent-certs\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-lib-modules\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-log-socket\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-registration-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e4a2940-4a7f-4876-9037-b065fdec7803-serviceca\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.388275 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbshs\" (UniqueName: \"kubernetes.io/projected/3e4a2940-4a7f-4876-9037-b065fdec7803-kube-api-access-jbshs\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387947 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-etc-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-node-log\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.388068 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.388164 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:49.888119252 +0000 UTC m=+3.028307392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388353 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-ovn\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389034 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-run\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.389141 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-config\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-os-release\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-etc-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389609 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cni-binary-copy\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389672 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-host-slash\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-daemon-config\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.389750 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-host\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.390243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389764 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-node-log\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.389777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cnibin\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.390243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.388068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-tuned\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.390243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.387711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9a931a5-9c6d-4ad5-bc01-f32248486449-konnectivity-ca\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.390243 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.390220 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:49.390493 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.390277 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:49.890258155 +0000 UTC m=+3.030446275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:49.390493 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-systemd-units\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390493 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-slash\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390655 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390535 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-slash\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390655 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-netns\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390655 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3544c995-cd90-4090-b348-6199ea1e7c1a-hosts-file\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.390655 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-k8s-cni-cncf-io\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-conf-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-multus-certs\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-var-lib-kubelet\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-bin\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390756 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-k8s-cni-cncf-io\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.390879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3544c995-cd90-4090-b348-6199ea1e7c1a-hosts-file\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-multus-certs\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390956 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-var-lib-kubelet\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.390951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-conf-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-multus\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-bin\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391034 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-run-netns\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-etc-kubernetes\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-log-socket\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtn4g\" (UniqueName: \"kubernetes.io/projected/fed8e59e-505d-4fb3-9988-f9474dd223d3-kube-api-access-vtn4g\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391115 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-registration-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-kubernetes\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-netns\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-var-lib-cni-multus\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-lib-modules\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-hostroot\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-systemd\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391233 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-kubernetes\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.391244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-etc-kubernetes\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.392133 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.391251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.392586 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.392561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3e4a2940-4a7f-4876-9037-b065fdec7803-serviceca\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.393265 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-hostroot\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.393265 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-systemd\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393343 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-tmp\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-host-run-netns\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-script-lib\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-tuned\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-dbus\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/971ceb35-e0cc-4f35-81e6-d3f941c2421b-cni-binary-copy\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.393839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-socket-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-device-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbsh2\" (UniqueName: \"kubernetes.io/projected/3544c995-cd90-4090-b348-6199ea1e7c1a-kube-api-access-sbsh2\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-modprobe-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysconfig\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-ovnkube-script-lib\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-env-overrides\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.396894 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-socket-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-systemd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9a931a5-9c6d-4ad5-bc01-f32248486449-agent-certs\") pod \"konnectivity-agent-kpwv5\" (UID: \"a9a931a5-9c6d-4ad5-bc01-f32248486449\") " pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-sys-fs\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-dbus\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-conf\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-netd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-device-dir\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56876218-059f-4079-bd7e-d55cd95a4a11-ovn-node-metrics-cert\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nvrl\" (UniqueName: \"kubernetes.io/projected/56876218-059f-4079-bd7e-d55cd95a4a11-kube-api-access-8nvrl\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-system-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-sys-fs\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-kubelet-config\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-kubelet\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cnibin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-socket-dir-parent\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4a2940-4a7f-4876-9037-b065fdec7803-host\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.397863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-sys\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56876218-059f-4079-bd7e-d55cd95a4a11-env-overrides\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394880 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-system-cni-dir\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394888 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-kubelet\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-var-lib-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394950 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-run-systemd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-modprobe-d\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.394954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-host-cni-netd\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395026 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysconfig\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395113 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-etc-sysctl-conf\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395184 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-cnibin\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ceace3b-3157-4d67-9f52-a05962f3fa4e-multus-socket-dir-parent\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e4a2940-4a7f-4876-9037-b065fdec7803-host\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8f8793a-c74f-4715-9d3f-2515d8b98aab-sys\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395349 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-iptables-alerter-script\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca3e117c-8409-4303-ab25-34e2e40350f6-kubelet-config\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56876218-059f-4079-bd7e-d55cd95a4a11-var-lib-openvswitch\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.398898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395456 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed8e59e-505d-4fb3-9988-f9474dd223d3-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.400042 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.395588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/971ceb35-e0cc-4f35-81e6-d3f941c2421b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.401113 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.401056 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56876218-059f-4079-bd7e-d55cd95a4a11-ovn-node-metrics-cert\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.402366 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.402303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrkmx\" (UniqueName: \"kubernetes.io/projected/371eed94-d2a5-49e2-ab48-ca8ef5dbba0d-kube-api-access-vrkmx\") pod \"iptables-alerter-dmlkt\" (UID: \"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d\") " pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.402993 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.402814 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:25:49.402993 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.402854 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:25:49.402993 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.402870 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:49.402993 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.402941 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:49.902921804 +0000 UTC m=+3.043109944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:49.406447 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.405953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtn4g\" (UniqueName: \"kubernetes.io/projected/fed8e59e-505d-4fb3-9988-f9474dd223d3-kube-api-access-vtn4g\") pod \"aws-ebs-csi-driver-node-fq7nr\" (UID: \"fed8e59e-505d-4fb3-9988-f9474dd223d3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.406447 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.406035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbshs\" (UniqueName: \"kubernetes.io/projected/3e4a2940-4a7f-4876-9037-b065fdec7803-kube-api-access-jbshs\") pod \"node-ca-vxndw\" (UID: \"3e4a2940-4a7f-4876-9037-b065fdec7803\") " pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.406623 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.406457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsq8g\" (UniqueName: \"kubernetes.io/projected/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-kube-api-access-gsq8g\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.408243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.408163 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbsh2\" (UniqueName: \"kubernetes.io/projected/3544c995-cd90-4090-b348-6199ea1e7c1a-kube-api-access-sbsh2\") pod \"node-resolver-tcpqb\" (UID: \"3544c995-cd90-4090-b348-6199ea1e7c1a\") " pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.408243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.408166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8qw\" (UniqueName: \"kubernetes.io/projected/2ceace3b-3157-4d67-9f52-a05962f3fa4e-kube-api-access-hm8qw\") pod \"multus-2rvww\" (UID: \"2ceace3b-3157-4d67-9f52-a05962f3fa4e\") " pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.408659 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.408634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nvrl\" (UniqueName: \"kubernetes.io/projected/56876218-059f-4079-bd7e-d55cd95a4a11-kube-api-access-8nvrl\") pod \"ovnkube-node-nrfvl\" (UID: \"56876218-059f-4079-bd7e-d55cd95a4a11\") " pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.409462 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.409372 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" event={"ID":"1073069d058afeea1cace0e31f40b482","Type":"ContainerStarted","Data":"b46d4431757faaf5f2d7d9902a5c703f375ed30c066da5cef04f359a25965838"} Jul 23 21:25:49.409551 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.409520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8fd7\" (UniqueName: \"kubernetes.io/projected/971ceb35-e0cc-4f35-81e6-d3f941c2421b-kube-api-access-z8fd7\") pod \"multus-additional-cni-plugins-f8nbc\" (UID: \"971ceb35-e0cc-4f35-81e6-d3f941c2421b\") " pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.411055 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.411035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plqdb\" (UniqueName: \"kubernetes.io/projected/c8f8793a-c74f-4715-9d3f-2515d8b98aab-kube-api-access-plqdb\") pod \"tuned-6ph65\" (UID: \"c8f8793a-c74f-4715-9d3f-2515d8b98aab\") " pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.411508 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.411481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" event={"ID":"c8af94d40da9ac8160345a87ba6c1a1f","Type":"ContainerStarted","Data":"ddcb4744377593ba536d2c45161ed93533d740a10b75959e1699caeac80d65d9"} Jul 23 21:25:49.569298 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.569215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tcpqb" Jul 23 21:25:49.577816 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.577788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ph65" Jul 23 21:25:49.579605 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.579563 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3544c995_cd90_4090_b348_6199ea1e7c1a.slice/crio-7ab64a4f0e2634359c34c08e4eb479db9cefb3b573ce1435926bbcca2d1250b2 WatchSource:0}: Error finding container 7ab64a4f0e2634359c34c08e4eb479db9cefb3b573ce1435926bbcca2d1250b2: Status 404 returned error can't find the container with id 7ab64a4f0e2634359c34c08e4eb479db9cefb3b573ce1435926bbcca2d1250b2 Jul 23 21:25:49.585981 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.585916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rvww" Jul 23 21:25:49.588386 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.587951 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f8793a_c74f_4715_9d3f_2515d8b98aab.slice/crio-0f1ec370ed42227673f4dba85203318b82cd2e4471360dbd88de1cb1ef4238cc WatchSource:0}: Error finding container 0f1ec370ed42227673f4dba85203318b82cd2e4471360dbd88de1cb1ef4238cc: Status 404 returned error can't find the container with id 0f1ec370ed42227673f4dba85203318b82cd2e4471360dbd88de1cb1ef4238cc Jul 23 21:25:49.590331 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.590149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" Jul 23 21:25:49.597073 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.596896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:25:49.597073 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.596896 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceace3b_3157_4d67_9f52_a05962f3fa4e.slice/crio-71aa6e9642d1d9b07deff5cdc6a4ae8edbd447939ca40c0055908b1373da6355 WatchSource:0}: Error finding container 71aa6e9642d1d9b07deff5cdc6a4ae8edbd447939ca40c0055908b1373da6355: Status 404 returned error can't find the container with id 71aa6e9642d1d9b07deff5cdc6a4ae8edbd447939ca40c0055908b1373da6355 Jul 23 21:25:49.599966 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.599935 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971ceb35_e0cc_4f35_81e6_d3f941c2421b.slice/crio-d9c2b269167903a980d4ba04773384563ea70b8d7e270ab58a98550720a50d78 WatchSource:0}: Error finding container d9c2b269167903a980d4ba04773384563ea70b8d7e270ab58a98550720a50d78: Status 404 returned error can't find the container with id d9c2b269167903a980d4ba04773384563ea70b8d7e270ab58a98550720a50d78 Jul 23 21:25:49.602832 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.602649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dmlkt" Jul 23 21:25:49.610529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.610504 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" Jul 23 21:25:49.615440 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.615415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:25:49.615985 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.615951 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371eed94_d2a5_49e2_ab48_ca8ef5dbba0d.slice/crio-185d88f4a65577d5acd536b5ec63e06a6bda0ca17edc6256f98f689404367b98 WatchSource:0}: Error finding container 185d88f4a65577d5acd536b5ec63e06a6bda0ca17edc6256f98f689404367b98: Status 404 returned error can't find the container with id 185d88f4a65577d5acd536b5ec63e06a6bda0ca17edc6256f98f689404367b98 Jul 23 21:25:49.616931 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.616901 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56876218_059f_4079_bd7e_d55cd95a4a11.slice/crio-cbd38f7bc267d9e33bf157d268b50f8c8947fc163ec582d1ef49e869c305c093 WatchSource:0}: Error finding container cbd38f7bc267d9e33bf157d268b50f8c8947fc163ec582d1ef49e869c305c093: Status 404 returned error can't find the container with id cbd38f7bc267d9e33bf157d268b50f8c8947fc163ec582d1ef49e869c305c093 Jul 23 21:25:49.620498 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.620341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxndw" Jul 23 21:25:49.626110 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.626085 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a931a5_9c6d_4ad5_bc01_f32248486449.slice/crio-815a2df4c67dc8c2e8c010620ec88b9e3b15bbd6e6b602339bb84a5f5a8d2df6 WatchSource:0}: Error finding container 815a2df4c67dc8c2e8c010620ec88b9e3b15bbd6e6b602339bb84a5f5a8d2df6: Status 404 returned error can't find the container with id 815a2df4c67dc8c2e8c010620ec88b9e3b15bbd6e6b602339bb84a5f5a8d2df6 Jul 23 21:25:49.627402 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.627328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed8e59e_505d_4fb3_9988_f9474dd223d3.slice/crio-ee405f95eeb9299196bbd62b28d76ca30af4f05ea95c6d43e0bb54aebccffda3 WatchSource:0}: Error finding container ee405f95eeb9299196bbd62b28d76ca30af4f05ea95c6d43e0bb54aebccffda3: Status 404 returned error can't find the container with id ee405f95eeb9299196bbd62b28d76ca30af4f05ea95c6d43e0bb54aebccffda3 Jul 23 21:25:49.634987 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:25:49.634961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4a2940_4a7f_4876_9037_b065fdec7803.slice/crio-68252f1913c52129c48024a107c0dbd3da6b74ed336c868ebc140344213a0f95 WatchSource:0}: Error finding container 68252f1913c52129c48024a107c0dbd3da6b74ed336c868ebc140344213a0f95: Status 404 returned error can't find the container with id 68252f1913c52129c48024a107c0dbd3da6b74ed336c868ebc140344213a0f95 Jul 23 21:25:49.899910 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.899814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:49.899910 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:49.899860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:49.900142 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.900003 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:49.900142 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.900093 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:50.900072265 +0000 UTC m=+4.040260402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:49.900142 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.900007 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:49.900318 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:49.900150 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:50.900138405 +0000 UTC m=+4.040326530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:50.000829 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.000789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:50.003855 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.001238 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:25:50.003855 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.001288 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:25:50.003855 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.001305 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:50.003855 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.001379 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:51.001359757 +0000 UTC m=+4.141547876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:50.403226 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.403080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:50.404025 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.403252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:50.414826 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.414719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxndw" event={"ID":"3e4a2940-4a7f-4876-9037-b065fdec7803","Type":"ContainerStarted","Data":"68252f1913c52129c48024a107c0dbd3da6b74ed336c868ebc140344213a0f95"} Jul 23 21:25:50.416679 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.416652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpwv5" event={"ID":"a9a931a5-9c6d-4ad5-bc01-f32248486449","Type":"ContainerStarted","Data":"815a2df4c67dc8c2e8c010620ec88b9e3b15bbd6e6b602339bb84a5f5a8d2df6"} Jul 23 21:25:50.418454 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.418420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dmlkt" event={"ID":"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d","Type":"ContainerStarted","Data":"185d88f4a65577d5acd536b5ec63e06a6bda0ca17edc6256f98f689404367b98"} Jul 23 21:25:50.420385 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.420351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rvww" event={"ID":"2ceace3b-3157-4d67-9f52-a05962f3fa4e","Type":"ContainerStarted","Data":"71aa6e9642d1d9b07deff5cdc6a4ae8edbd447939ca40c0055908b1373da6355"} Jul 23 21:25:50.421895 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.421871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tcpqb" event={"ID":"3544c995-cd90-4090-b348-6199ea1e7c1a","Type":"ContainerStarted","Data":"7ab64a4f0e2634359c34c08e4eb479db9cefb3b573ce1435926bbcca2d1250b2"} Jul 23 21:25:50.423469 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.423437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" event={"ID":"fed8e59e-505d-4fb3-9988-f9474dd223d3","Type":"ContainerStarted","Data":"ee405f95eeb9299196bbd62b28d76ca30af4f05ea95c6d43e0bb54aebccffda3"} Jul 23 21:25:50.424833 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.424805 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"cbd38f7bc267d9e33bf157d268b50f8c8947fc163ec582d1ef49e869c305c093"} Jul 23 21:25:50.426449 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.426411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerStarted","Data":"d9c2b269167903a980d4ba04773384563ea70b8d7e270ab58a98550720a50d78"} Jul 23 21:25:50.427986 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.427953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ph65" event={"ID":"c8f8793a-c74f-4715-9d3f-2515d8b98aab","Type":"ContainerStarted","Data":"0f1ec370ed42227673f4dba85203318b82cd2e4471360dbd88de1cb1ef4238cc"} Jul 23 21:25:50.909450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.909410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:50.909635 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:50.909465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:50.909635 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.909614 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:50.909753 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.909701 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:52.909678999 +0000 UTC m=+6.049867140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:50.909923 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.909621 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:50.909923 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:50.909860 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:52.909836681 +0000 UTC m=+6.050024811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:51.010628 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:51.010585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:51.010803 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.010774 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:25:51.010908 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.010815 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:25:51.010908 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.010830 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:51.010908 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.010897 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:53.010877686 +0000 UTC m=+6.151066043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:51.042705 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:51.042667 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:25:51.403891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:51.403045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:51.403891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:51.403045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:51.403891 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.403195 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:51.403891 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:51.403266 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:25:52.403154 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.402807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:52.403331 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:52.403222 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:52.457940 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.457893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" event={"ID":"c8af94d40da9ac8160345a87ba6c1a1f","Type":"ContainerStarted","Data":"0f74b4e3bae632775b2fee3660c94e3e42e62cf89f436db5ff0c342903110c4b"} Jul 23 21:25:52.461931 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.461898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" event={"ID":"1073069d058afeea1cace0e31f40b482","Type":"ContainerStarted","Data":"93ed4e2f7a74a561db7f825b0e84f4b3910c84c394124cce583bc6fabce7c4f8"} Jul 23 21:25:52.501436 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.501119 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-109.ec2.internal" podStartSLOduration=3.501095393 podStartE2EDuration="3.501095393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:25:52.475915635 +0000 UTC m=+5.616103776" watchObservedRunningTime="2026-07-23 21:25:52.501095393 +0000 UTC m=+5.641283534" Jul 23 21:25:52.927399 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.927362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:52.927624 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:52.927417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:52.927624 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:52.927601 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:52.927758 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:52.927668 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:56.927648933 +0000 UTC m=+10.067837072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:52.928198 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:52.928120 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:52.928198 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:52.928185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:56.928166648 +0000 UTC m=+10.068354770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:53.029787 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:53.028910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:53.029787 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.029120 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:25:53.029787 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.029143 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:25:53.029787 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.029159 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:53.029787 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.029223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:25:57.02920326 +0000 UTC m=+10.169391379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:53.403629 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:53.403010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:53.403629 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.403181 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:53.404358 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:53.403986 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:53.404358 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:53.404223 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:25:54.402791 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:54.402743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:54.403314 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:54.402964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:55.403533 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:55.403449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:55.404031 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:55.403593 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:55.404031 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:55.403657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:55.404031 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:55.403771 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:25:55.473853 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:55.472921 2578 generic.go:356] "Generic (PLEG): container finished" podID="1073069d058afeea1cace0e31f40b482" containerID="93ed4e2f7a74a561db7f825b0e84f4b3910c84c394124cce583bc6fabce7c4f8" exitCode=0 Jul 23 21:25:55.473853 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:55.472975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" event={"ID":"1073069d058afeea1cace0e31f40b482","Type":"ContainerDied","Data":"93ed4e2f7a74a561db7f825b0e84f4b3910c84c394124cce583bc6fabce7c4f8"} Jul 23 21:25:56.402224 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:56.402176 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:56.402399 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:56.402341 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:56.965298 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:56.965255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:56.965772 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:56.965315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:56.965772 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:56.965481 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:56.965772 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:56.965545 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:04.96552649 +0000 UTC m=+18.105714628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:25:56.965772 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:56.965564 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:56.965772 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:56.965603 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:04.965591978 +0000 UTC m=+18.105780108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:25:57.065757 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:57.065713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:57.065950 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.065931 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:25:57.066024 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.065954 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:25:57.066024 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.065969 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:57.066128 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.066039 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:05.066019543 +0000 UTC m=+18.206207677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:25:57.403951 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:57.403759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:57.403951 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.403902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:25:57.403951 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:57.403911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:57.404234 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:57.404001 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:58.402767 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:58.402672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:25:58.403281 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:58.402873 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:25:59.403482 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:59.403447 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:25:59.403482 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:25:59.403487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:25:59.404111 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:59.403600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:25:59.404111 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:25:59.403727 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:00.402469 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:00.402440 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:00.402709 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:00.402662 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:01.402431 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:01.402400 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:01.402919 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:01.402536 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:01.402919 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:01.402606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:01.402919 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:01.402716 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:02.402350 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:02.402301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:02.402534 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:02.402448 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:03.403186 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:03.403140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:03.403662 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:03.403275 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:03.403662 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:03.403332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:03.403662 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:03.403445 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:04.402787 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:04.402736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:04.403001 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:04.402881 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:05.025516 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:05.025480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:05.025516 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:05.025523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:05.026020 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.025638 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.026020 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.025694 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:21.025681329 +0000 UTC m=+34.165869443 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:05.026020 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.025639 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:05.026020 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.025789 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:21.025775214 +0000 UTC m=+34.165963345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:05.126174 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:05.126137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:05.126323 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.126287 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:05.126323 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.126305 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:05.126323 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.126313 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.126468 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.126374 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:21.126356931 +0000 UTC m=+34.266545062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:05.402983 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:05.402910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:05.403118 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.403024 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:05.403118 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:05.403077 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:05.403183 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:05.403167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:06.402734 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:06.402690 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:06.403245 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:06.402838 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:07.403465 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:07.403430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:07.403924 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:07.403543 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:07.403924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:07.403599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:07.403924 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:07.403720 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:08.402684 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:08.402637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:08.402860 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:08.402796 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:09.402594 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:09.402559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:09.402594 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:09.402579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:09.403201 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:09.402674 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:09.403201 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:09.402779 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:10.402884 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.402559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:10.403479 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:10.402971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:10.504775 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.504733 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" event={"ID":"1073069d058afeea1cace0e31f40b482","Type":"ContainerStarted","Data":"93e05f04545e002ee83029c7ed598aa3ab19bf353da92ca9514677abe8babb16"} Jul 23 21:26:10.506031 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.506002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxndw" event={"ID":"3e4a2940-4a7f-4876-9037-b065fdec7803","Type":"ContainerStarted","Data":"5557843449c163eb168f494f6158d9d3b98d306dbbff9d344b0da271ae57addd"} Jul 23 21:26:10.507372 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.507352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kpwv5" event={"ID":"a9a931a5-9c6d-4ad5-bc01-f32248486449","Type":"ContainerStarted","Data":"bbadb77130f8a158a6a82a22a579438fb7169618dcfcc9356be1dbe7abb102cb"} Jul 23 21:26:10.508728 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.508706 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rvww" event={"ID":"2ceace3b-3157-4d67-9f52-a05962f3fa4e","Type":"ContainerStarted","Data":"1527ef1c173f3ae082e05771c084828b2c1312f5c2c0300398471092357a4da4"} Jul 23 21:26:10.510111 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.510090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tcpqb" event={"ID":"3544c995-cd90-4090-b348-6199ea1e7c1a","Type":"ContainerStarted","Data":"7eb7bf578c781d39881a2e30723bc7ed0718759126f1c86ba92d0a8a71b83ae0"} Jul 23 21:26:10.511411 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.511393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" event={"ID":"fed8e59e-505d-4fb3-9988-f9474dd223d3","Type":"ContainerStarted","Data":"974dd13781860c51cfb60582324eb8ee315460eded822f64bf01f0152b0aac84"} Jul 23 21:26:10.513774 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.513738 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"3e30d31b9f3f4918df764e3b53d0e9898884a425b30f0ec2ad0c850c871a77e0"} Jul 23 21:26:10.513869 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.513809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"f86c0ecb78d3ed8d1e0a273e6de1047a49de924613d65701ca8611e1a935a2db"} Jul 23 21:26:10.513869 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.513847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"d18badedb6b9a99ab75b6ec550279a520732cff9dd5ef6e88c4b1a99c11e2227"} Jul 23 21:26:10.513951 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.513877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"63b18748e66516fb6a32b3c5035a0a202689faaa6d17915a292143045c853f1a"} Jul 23 21:26:10.513951 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.513904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"3ab3336ee15d1a387514310c3cd9f0bb8ba859de93404f953078ab49581a621c"} Jul 23 21:26:10.515157 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.515129 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="c02ede79a910195524124dd8b0ef5bd6ca5e395b8e88f6e62eda980dbdbf2bf3" exitCode=0 Jul 23 21:26:10.515252 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.515212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"c02ede79a910195524124dd8b0ef5bd6ca5e395b8e88f6e62eda980dbdbf2bf3"} Jul 23 21:26:10.516559 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.516512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ph65" event={"ID":"c8f8793a-c74f-4715-9d3f-2515d8b98aab","Type":"ContainerStarted","Data":"3408b105a04c84eb46b79f3b5b760203e029186bd63beff62f1d2630bf7e47f4"} Jul 23 21:26:10.536443 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.536403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-109.ec2.internal" podStartSLOduration=21.536389 podStartE2EDuration="21.536389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.5214856 +0000 UTC m=+23.661673737" watchObservedRunningTime="2026-07-23 21:26:10.536389 +0000 UTC m=+23.676577135" Jul 23 21:26:10.549074 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.549019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vxndw" podStartSLOduration=2.321202205 podStartE2EDuration="22.548997868s" totalImagesPullingTime="20.227795663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.548910078 +0000 UTC m=+23.689098213" watchObservedRunningTime="2026-07-23 21:26:10.548997868 +0000 UTC m=+23.689186005" Jul 23 21:26:10.549378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.549344 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kpwv5" podStartSLOduration=2.313336805 podStartE2EDuration="22.549333536s" totalImagesPullingTime="20.235996731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.536109899 +0000 UTC m=+23.676298034" watchObservedRunningTime="2026-07-23 21:26:10.549333536 +0000 UTC m=+23.689521674" Jul 23 21:26:10.562262 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.562218 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tcpqb" podStartSLOduration=2.278466062 podStartE2EDuration="22.562204944s" totalImagesPullingTime="20.283738882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.561722091 +0000 UTC m=+23.701910252" watchObservedRunningTime="2026-07-23 21:26:10.562204944 +0000 UTC m=+23.702393079" Jul 23 21:26:10.599857 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.599805 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2rvww" podStartSLOduration=2.281098273 podStartE2EDuration="22.59978824s" totalImagesPullingTime="20.318689967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.578421317 +0000 UTC m=+23.718609450" watchObservedRunningTime="2026-07-23 21:26:10.59978824 +0000 UTC m=+23.739976373" Jul 23 21:26:10.615915 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:10.615868 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6ph65" podStartSLOduration=2.3402435600000002 podStartE2EDuration="22.615853014s" totalImagesPullingTime="20.275609454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:10.615541774 +0000 UTC m=+23.755729909" watchObservedRunningTime="2026-07-23 21:26:10.615853014 +0000 UTC m=+23.756041148" Jul 23 21:26:11.402938 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.402905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:11.403302 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.402905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:11.403302 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:11.403009 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:11.403302 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:11.403111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:11.520198 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.520164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dmlkt" event={"ID":"371eed94-d2a5-49e2-ab48-ca8ef5dbba0d","Type":"ContainerStarted","Data":"fc5ebb45e207c889432decea6dd485a4f7b9eea3078c48ff92e5606a90145a27"} Jul 23 21:26:11.523677 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.523636 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"e2a26a34bfee9600fc8cb2dcef1ff237fdc68c35489fd53dee568d639b515e0b"} Jul 23 21:26:11.534853 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.534800 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dmlkt" podStartSLOduration=3.26945258 podStartE2EDuration="23.534782293s" totalImagesPullingTime="20.265329713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:11.533944895 +0000 UTC m=+24.674133031" watchObservedRunningTime="2026-07-23 21:26:11.534782293 +0000 UTC m=+24.674970431" Jul 23 21:26:11.610041 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:11.609977 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 21:26:12.348619 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.348522 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T21:26:11.609998522Z","UUID":"d5bfdd9e-7c4f-40a0-a87f-b40b41f35f6a","Handler":null,"Name":"","Endpoint":""} Jul 23 21:26:12.350443 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.350422 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 21:26:12.350575 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.350465 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 21:26:12.402873 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.402847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:12.403036 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:12.402957 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:12.528879 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.528838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" event={"ID":"fed8e59e-505d-4fb3-9988-f9474dd223d3","Type":"ContainerStarted","Data":"59c623bf773235cbce56622f2a6e7a5e3e810fec1709edfd5611ba8c39138e82"} Jul 23 21:26:12.797490 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.797358 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:26:12.798055 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:12.798035 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:26:13.403082 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.402872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:13.403547 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.402872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:13.403547 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:13.403188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:13.403547 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:13.403259 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:13.532562 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.532525 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" event={"ID":"fed8e59e-505d-4fb3-9988-f9474dd223d3","Type":"ContainerStarted","Data":"4f65177c49b6c0da9736ea94683aced42b927dc8e701a07dc9fb44e742023fde"} Jul 23 21:26:13.535332 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.535307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"133846e96b966c8c7b53cecac91f9579e9aa3ed55794fa46e64e43ffe842effa"} Jul 23 21:26:13.535457 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.535378 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:26:13.535902 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.535882 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kpwv5" Jul 23 21:26:13.550234 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:13.550167 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq7nr" podStartSLOduration=2.645499347 podStartE2EDuration="25.550149314s" totalImagesPullingTime="22.904649967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:13.549642068 +0000 UTC m=+26.689830230" watchObservedRunningTime="2026-07-23 21:26:13.550149314 +0000 UTC m=+26.690337451" Jul 23 21:26:14.402862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:14.402826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:14.403043 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:14.402964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:15.402272 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.402245 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:15.403140 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:15.402374 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:15.403140 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.402422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:15.403140 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:15.402529 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:15.544133 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.543920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" event={"ID":"56876218-059f-4079-bd7e-d55cd95a4a11","Type":"ContainerStarted","Data":"66fae696b8655c18953f3b4b5860931b5b49e0aa7e5a61758979967176e7ef96"} Jul 23 21:26:15.544256 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.544191 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:15.546342 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.546311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerStarted","Data":"fd21638cc6e62ad718d254f52d8dbbad96e82559993acd11b677b466a619d1bd"} Jul 23 21:26:15.559242 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.559213 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:15.574856 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:15.574817 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" podStartSLOduration=7.25284627 podStartE2EDuration="27.574803009s" totalImagesPullingTime="20.321956739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:15.574659071 +0000 UTC m=+28.714847216" watchObservedRunningTime="2026-07-23 21:26:15.574803009 +0000 UTC m=+28.714991144" Jul 23 21:26:16.403099 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.403063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:16.403553 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:16.403172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:16.550718 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.550680 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="fd21638cc6e62ad718d254f52d8dbbad96e82559993acd11b677b466a619d1bd" exitCode=0 Jul 23 21:26:16.550868 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.550773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"fd21638cc6e62ad718d254f52d8dbbad96e82559993acd11b677b466a619d1bd"} Jul 23 21:26:16.551354 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.551223 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:16.551354 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.551299 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:16.569842 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:16.569793 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:17.403531 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.403495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:17.403990 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:17.403612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:17.403990 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.403664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:17.403990 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:17.403761 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:17.407055 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.407033 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfk45"] Jul 23 21:26:17.410303 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.410280 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2fgj"] Jul 23 21:26:17.410874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.410846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmbts"] Jul 23 21:26:17.410994 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.410925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:17.411054 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:17.411032 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:17.552660 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.552633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:17.552825 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:17.552633 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:17.552825 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:17.552739 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:17.552919 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:17.552842 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:18.557195 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:18.557157 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="44ef62afd818e186158e4c145df3cc47ec89ca1271cbdeb7635ca5b0425ddc7f" exitCode=0 Jul 23 21:26:18.557598 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:18.557240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"44ef62afd818e186158e4c145df3cc47ec89ca1271cbdeb7635ca5b0425ddc7f"} Jul 23 21:26:19.403113 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:19.402841 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:19.403280 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:19.402857 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:19.403280 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:19.403214 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:19.403280 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:19.402906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:19.403443 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:19.403292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:19.403443 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:19.403374 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:20.564576 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:20.564544 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="02b9311b66c572555a09fdc64d71724767b59fd6cd8dd5eaacb9ec15a8261100" exitCode=0 Jul 23 21:26:20.565171 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:20.564588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"02b9311b66c572555a09fdc64d71724767b59fd6cd8dd5eaacb9ec15a8261100"} Jul 23 21:26:21.053969 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.053936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:21.054130 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.053973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:21.054130 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.054069 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:21.054130 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.054089 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:21.054130 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.054125 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret podName:ca3e117c-8409-4303-ab25-34e2e40350f6 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:53.054111974 +0000 UTC m=+66.194300088 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret") pod "global-pull-secret-syncer-tfk45" (UID: "ca3e117c-8409-4303-ab25-34e2e40350f6") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:21.054265 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.054144 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:53.054131195 +0000 UTC m=+66.194319332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:21.154904 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.154874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:21.155073 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.155058 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:21.155138 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.155086 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:21.155138 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.155103 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4c8gd for pod openshift-network-diagnostics/network-check-target-w2fgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:21.155232 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.155171 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd podName:5952f7e7-a4de-4789-a580-76b2c6b78683 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:53.155151622 +0000 UTC m=+66.295339756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4c8gd" (UniqueName: "kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd") pod "network-check-target-w2fgj" (UID: "5952f7e7-a4de-4789-a580-76b2c6b78683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:21.402527 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.402436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:21.402527 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.402436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:21.402810 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:21.402574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:21.402810 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.402577 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:26:21.402810 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.402675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tfk45" podUID="ca3e117c-8409-4303-ab25-34e2e40350f6" Jul 23 21:26:21.402810 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:21.402769 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2fgj" podUID="5952f7e7-a4de-4789-a580-76b2c6b78683" Jul 23 21:26:22.659721 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.659644 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-109.ec2.internal" event="NodeReady" Jul 23 21:26:22.660203 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.659802 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 21:26:22.692231 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.691659 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:26:22.695130 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.695110 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc"] Jul 23 21:26:22.695255 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.695239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.697937 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.697913 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 21:26:22.698121 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.697940 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 21:26:22.698121 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.697963 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8zssn\"" Jul 23 21:26:22.698516 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.698391 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 21:26:22.698691 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.698672 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.702086 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.702064 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vbp4r\"" Jul 23 21:26:22.702166 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.702106 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 21:26:22.703119 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.703006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 21:26:22.704244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.704060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 21:26:22.707378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.707223 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc"] Jul 23 21:26:22.709109 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.709088 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cxr59"] Jul 23 21:26:22.713080 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.713016 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:26:22.713178 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.713117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.713415 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.713395 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jg45h"] Jul 23 21:26:22.715523 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.715507 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 21:26:22.715585 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.715542 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 21:26:22.715770 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.715738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:26:22.716844 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.716831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.719166 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.719003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 21:26:22.720079 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.720030 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cxr59"] Jul 23 21:26:22.720231 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.720184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 21:26:22.720421 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.720405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 21:26:22.720758 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.720722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqp97\"" Jul 23 21:26:22.727147 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.724615 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jg45h"] Jul 23 21:26:22.864507 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.864394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:22.865259 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.865394 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkn5s\" (UniqueName: \"kubernetes.io/projected/68aefd2f-950d-4dbd-8761-0d77116dac38-kube-api-access-xkn5s\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.865394 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865394 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865569 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865569 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56720bc5-45d5-48fd-956e-b8c2336efcdb-cert\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.865569 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn2rd\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865569 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865569 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68aefd2f-950d-4dbd-8761-0d77116dac38-tmp-dir\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vc5r\" (UniqueName: \"kubernetes.io/projected/56720bc5-45d5-48fd-956e-b8c2336efcdb-kube-api-access-5vc5r\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68aefd2f-950d-4dbd-8761-0d77116dac38-config-volume\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.865815 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.866104 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.865822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.949159 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.949072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:22.967162 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.967338 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56720bc5-45d5-48fd-956e-b8c2336efcdb-cert\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.967458 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn2rd\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.967599 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.967654 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.967712 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.967776 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68aefd2f-950d-4dbd-8761-0d77116dac38-tmp-dir\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.967776 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc5r\" (UniqueName: \"kubernetes.io/projected/56720bc5-45d5-48fd-956e-b8c2336efcdb-kube-api-access-5vc5r\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.967877 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68aefd2f-950d-4dbd-8761-0d77116dac38-config-volume\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.967877 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.967877 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.967877 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968064 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.968064 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkn5s\" (UniqueName: \"kubernetes.io/projected/68aefd2f-950d-4dbd-8761-0d77116dac38-kube-api-access-xkn5s\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.968064 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968064 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.967974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68aefd2f-950d-4dbd-8761-0d77116dac38-tmp-dir\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.967762 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968118 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968135 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968155 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.468134804 +0000 UTC m=+36.608322937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:22.968260 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968186 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.46816802 +0000 UTC m=+36.608356162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:22.968566 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968431 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:22.968566 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:22.968471 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.468458566 +0000 UTC m=+36.608646692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:22.968566 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968520 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968786 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968786 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968773 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.968913 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68aefd2f-950d-4dbd-8761-0d77116dac38-config-volume\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.968913 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.968774 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:22.972299 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.972275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.972408 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.972296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/56720bc5-45d5-48fd-956e-b8c2336efcdb-cert\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:22.972408 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.972275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.976580 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.976553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.976868 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.976818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn2rd\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:22.977175 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.977155 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkn5s\" (UniqueName: \"kubernetes.io/projected/68aefd2f-950d-4dbd-8761-0d77116dac38-kube-api-access-xkn5s\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:22.977240 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:22.977200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc5r\" (UniqueName: \"kubernetes.io/projected/56720bc5-45d5-48fd-956e-b8c2336efcdb-kube-api-access-5vc5r\") pod \"ingress-canary-jg45h\" (UID: \"56720bc5-45d5-48fd-956e-b8c2336efcdb\") " pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:23.031629 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.031589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jg45h" Jul 23 21:26:23.185249 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.185219 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jg45h"] Jul 23 21:26:23.188781 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:23.188733 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56720bc5_45d5_48fd_956e_b8c2336efcdb.slice/crio-f35ba4d48aacb675176d5955eee04476f054602e84f0054db6955b889c6d2ea5 WatchSource:0}: Error finding container f35ba4d48aacb675176d5955eee04476f054602e84f0054db6955b889c6d2ea5: Status 404 returned error can't find the container with id f35ba4d48aacb675176d5955eee04476f054602e84f0054db6955b889c6d2ea5 Jul 23 21:26:23.402496 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.402458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:23.402695 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.402464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:23.402695 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.402604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:23.405186 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.405159 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:26:23.405322 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.405272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:26:23.406448 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.406426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:26:23.406548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.406472 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:26:23.406548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.406481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:26:23.406548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.406475 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:26:23.472606 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.472575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:23.472799 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.472623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:23.472799 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472735 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:23.472799 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472761 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:23.472799 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.472769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:23.472975 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472814 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:24.472797802 +0000 UTC m=+37.612985919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:23.472975 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472847 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:23.472975 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472851 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:23.472975 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:24.472886193 +0000 UTC m=+37.613074313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:23.472975 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:23.472919 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:24.472909184 +0000 UTC m=+37.613097306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:23.572798 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:23.572759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jg45h" event={"ID":"56720bc5-45d5-48fd-956e-b8c2336efcdb","Type":"ContainerStarted","Data":"f35ba4d48aacb675176d5955eee04476f054602e84f0054db6955b889c6d2ea5"} Jul 23 21:26:24.481886 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:24.481842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:24.481949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:24.481990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482020 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482098 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:26.482074522 +0000 UTC m=+39.622262653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482105 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482108 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482118 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482168 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:26.482153538 +0000 UTC m=+39.622341680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:24.482469 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:24.482203 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:26.482188076 +0000 UTC m=+39.622376190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:25.581221 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:25.581181 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="c38bbb9db72ad96c56c3c92e5e3e255efebffd64f549c181b7ad96a78640de5e" exitCode=0 Jul 23 21:26:25.581678 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:25.581234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"c38bbb9db72ad96c56c3c92e5e3e255efebffd64f549c181b7ad96a78640de5e"} Jul 23 21:26:26.324796 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.324762 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:26.394943 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.394910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:26.497713 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.497681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:26.497888 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.497787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:26.497888 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.497823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:26.497888 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.497859 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:26.497983 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.497916 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:26.497983 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.497919 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:26.497983 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.497928 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:26.497983 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.497919 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:30.497901783 +0000 UTC m=+43.638089904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:26.498144 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.498001 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:30.497988249 +0000 UTC m=+43.638176364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:26.498144 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:26.498016 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:30.49800984 +0000 UTC m=+43.638197954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:26.587497 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.587406 2578 generic.go:356] "Generic (PLEG): container finished" podID="971ceb35-e0cc-4f35-81e6-d3f941c2421b" containerID="4a4290f0aecdb1c5936a899c1856971fa37a036176d78c1b929b2e61a4d93d0c" exitCode=0 Jul 23 21:26:26.587497 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.587461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerDied","Data":"4a4290f0aecdb1c5936a899c1856971fa37a036176d78c1b929b2e61a4d93d0c"} Jul 23 21:26:26.632512 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.632479 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88"] Jul 23 21:26:26.641718 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.641693 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4"] Jul 23 21:26:26.641897 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.641832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.644949 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.644734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 21:26:26.644949 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.644764 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 21:26:26.644949 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.644774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qxgz7\"" Jul 23 21:26:26.644949 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.644734 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 21:26:26.644949 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.644889 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 21:26:26.648108 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.648086 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88"] Jul 23 21:26:26.648228 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.648183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.648228 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.648217 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4"] Jul 23 21:26:26.650321 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.650299 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 23 21:26:26.662248 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.662220 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z"] Jul 23 21:26:26.667862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.667837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.670414 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.670392 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 23 21:26:26.670530 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.670413 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 23 21:26:26.670530 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.670509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 23 21:26:26.670650 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.670529 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 23 21:26:26.677672 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.677638 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z"] Jul 23 21:26:26.799992 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.799955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.800166 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a353115-cfb1-475e-abaa-cfcadc2ae558-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.800166 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.800166 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3016735-b759-4397-87cd-df8e35c82be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.800324 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pks\" (UniqueName: \"kubernetes.io/projected/c6118498-3947-4ed3-899a-ca867b9a8e4e-kube-api-access-b9pks\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.800324 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.800415 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6118498-3947-4ed3-899a-ca867b9a8e4e-tmp\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.800415 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzfk\" (UniqueName: \"kubernetes.io/projected/b3016735-b759-4397-87cd-df8e35c82be1-kube-api-access-8pzfk\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.800555 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zntm\" (UniqueName: \"kubernetes.io/projected/8a353115-cfb1-475e-abaa-cfcadc2ae558-kube-api-access-7zntm\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.800604 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6118498-3947-4ed3-899a-ca867b9a8e4e-klusterlet-config\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.800670 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.800600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901375 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901375 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3016735-b759-4397-87cd-df8e35c82be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901375 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pks\" (UniqueName: \"kubernetes.io/projected/c6118498-3947-4ed3-899a-ca867b9a8e4e-kube-api-access-b9pks\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.901597 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901597 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6118498-3947-4ed3-899a-ca867b9a8e4e-tmp\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.901597 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzfk\" (UniqueName: \"kubernetes.io/projected/b3016735-b759-4397-87cd-df8e35c82be1-kube-api-access-8pzfk\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901597 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zntm\" (UniqueName: \"kubernetes.io/projected/8a353115-cfb1-475e-abaa-cfcadc2ae558-kube-api-access-7zntm\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.901768 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6118498-3947-4ed3-899a-ca867b9a8e4e-klusterlet-config\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.901768 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901768 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.901768 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.901687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a353115-cfb1-475e-abaa-cfcadc2ae558-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.902986 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.902954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3016735-b759-4397-87cd-df8e35c82be1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.903279 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.903257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6118498-3947-4ed3-899a-ca867b9a8e4e-tmp\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.907162 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.907000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.907427 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.907402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-ca\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.907526 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.907406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a353115-cfb1-475e-abaa-cfcadc2ae558-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.908250 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.908225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.908250 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.908225 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6118498-3947-4ed3-899a-ca867b9a8e4e-klusterlet-config\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.908802 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.908733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b3016735-b759-4397-87cd-df8e35c82be1-hub\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.911459 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.911433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pks\" (UniqueName: \"kubernetes.io/projected/c6118498-3947-4ed3-899a-ca867b9a8e4e-kube-api-access-b9pks\") pod \"klusterlet-addon-workmgr-846d8c66b7-75qp4\" (UID: \"c6118498-3947-4ed3-899a-ca867b9a8e4e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.911734 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.911703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zntm\" (UniqueName: \"kubernetes.io/projected/8a353115-cfb1-475e-abaa-cfcadc2ae558-kube-api-access-7zntm\") pod \"managed-serviceaccount-addon-agent-684b4fb788-9rg88\" (UID: \"8a353115-cfb1-475e-abaa-cfcadc2ae558\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.911829 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.911801 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzfk\" (UniqueName: \"kubernetes.io/projected/b3016735-b759-4397-87cd-df8e35c82be1-kube-api-access-8pzfk\") pod \"cluster-proxy-proxy-agent-cd4c74c8c-l5n9z\" (UID: \"b3016735-b759-4397-87cd-df8e35c82be1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:26.964840 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.964812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:26:26.970982 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.970953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:26.980509 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:26.980485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:26:27.345371 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.345326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:27.418768 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.408799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:27.503208 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.503184 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88"] Jul 23 21:26:27.504109 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.504085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z"] Jul 23 21:26:27.506030 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.506008 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4"] Jul 23 21:26:27.506131 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:27.506064 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3016735_b759_4397_87cd_df8e35c82be1.slice/crio-57ba2e64116746a5c5ae827f499923bdbdfdc63aa6ef76f94f603190fe6b48b1 WatchSource:0}: Error finding container 57ba2e64116746a5c5ae827f499923bdbdfdc63aa6ef76f94f603190fe6b48b1: Status 404 returned error can't find the container with id 57ba2e64116746a5c5ae827f499923bdbdfdc63aa6ef76f94f603190fe6b48b1 Jul 23 21:26:27.506871 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:27.506849 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a353115_cfb1_475e_abaa_cfcadc2ae558.slice/crio-20ec9190634543f388c2d0ca620efef0966c51708473b34fc504d5e7fff322d7 WatchSource:0}: Error finding container 20ec9190634543f388c2d0ca620efef0966c51708473b34fc504d5e7fff322d7: Status 404 returned error can't find the container with id 20ec9190634543f388c2d0ca620efef0966c51708473b34fc504d5e7fff322d7 Jul 23 21:26:27.510358 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:27.510337 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6118498_3947_4ed3_899a_ca867b9a8e4e.slice/crio-370f5edade109f63ded4002addeb7d1400b4c233812cf18b3d3d85bc43dd673e WatchSource:0}: Error finding container 370f5edade109f63ded4002addeb7d1400b4c233812cf18b3d3d85bc43dd673e: Status 404 returned error can't find the container with id 370f5edade109f63ded4002addeb7d1400b4c233812cf18b3d3d85bc43dd673e Jul 23 21:26:27.593287 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.593197 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" event={"ID":"971ceb35-e0cc-4f35-81e6-d3f941c2421b","Type":"ContainerStarted","Data":"e7d9f4aedf744bb0bb1244fb41cc3bce6a82ee4bab34e90024a862198682dd24"} Jul 23 21:26:27.594501 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.594334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerStarted","Data":"57ba2e64116746a5c5ae827f499923bdbdfdc63aa6ef76f94f603190fe6b48b1"} Jul 23 21:26:27.595400 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.595378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerStarted","Data":"20ec9190634543f388c2d0ca620efef0966c51708473b34fc504d5e7fff322d7"} Jul 23 21:26:27.596380 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.596357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerStarted","Data":"370f5edade109f63ded4002addeb7d1400b4c233812cf18b3d3d85bc43dd673e"} Jul 23 21:26:27.614343 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.614302 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f8nbc" podStartSLOduration=7.40945415 podStartE2EDuration="39.614288599s" totalImagesPullingTime="32.204834449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:27.612813388 +0000 UTC m=+40.753001523" watchObservedRunningTime="2026-07-23 21:26:27.614288599 +0000 UTC m=+40.754476776" Jul 23 21:26:27.733728 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.733692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:27.790000 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:27.789973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:28.072601 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.072570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:28.172523 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.172495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:28.314785 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.314730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:28.615502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.615462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jg45h" event={"ID":"56720bc5-45d5-48fd-956e-b8c2336efcdb","Type":"ContainerStarted","Data":"5be33c7223f86274461a152157e387a89ee1caf303fbbbb8b878225e0dff3471"} Jul 23 21:26:28.631708 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.630943 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jg45h" podStartSLOduration=2.1112043639999998 podStartE2EDuration="6.630920542s" totalImagesPullingTime="4.519716178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:28.630272758 +0000 UTC m=+41.770460899" watchObservedRunningTime="2026-07-23 21:26:28.630920542 +0000 UTC m=+41.771108681" Jul 23 21:26:28.731540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.731484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:28.824417 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:28.824349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:29.473847 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:29.473812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:29.575309 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:29.575275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:29.633766 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:29.633684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:30.539492 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:30.539451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:30.539662 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:30.539529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:30.539662 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:30.539602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:30.539795 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539705 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:30.539795 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539776 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:30.539795 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539789 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:38.539769449 +0000 UTC m=+51.679957583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:30.539929 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539812 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:38.539801978 +0000 UTC m=+51.679990099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:30.539929 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539709 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:30.539929 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539826 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:30.539929 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:30.539852 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:38.53984428 +0000 UTC m=+51.680032400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:34.632704 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.632672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerStarted","Data":"37b108e7d592140cdec42c59a79da005ab86ac6c2cea60be51df9da98d5ec5ec"} Jul 23 21:26:34.634259 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.634234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerStarted","Data":"e4fe033cef058f1220af3ff8833a7f2f2161f4cc48e1058d353799843f10f6a3"} Jul 23 21:26:34.634372 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.634290 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:34.636481 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.636420 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:26:34.636596 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.636538 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerStarted","Data":"aa0ff953418051a78c3fa7d24ddf23c055560cf5250357a6940b8e522097e5a9"} Jul 23 21:26:34.636596 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.636570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerStarted","Data":"7a7e966406a69b24b156f583aabd5f80c1469cec51c22479ae2f59802d270b32"} Jul 23 21:26:34.654165 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.654125 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" podStartSLOduration=1.851809572 podStartE2EDuration="8.654111483s" totalImagesPullingTime="6.802301911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:34.653077728 +0000 UTC m=+47.793265863" watchObservedRunningTime="2026-07-23 21:26:34.654111483 +0000 UTC m=+47.794299618" Jul 23 21:26:34.696484 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:34.696429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" podStartSLOduration=1.895135889 podStartE2EDuration="8.696409122s" totalImagesPullingTime="6.801273233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:34.695415312 +0000 UTC m=+47.835603459" watchObservedRunningTime="2026-07-23 21:26:34.696409122 +0000 UTC m=+47.836597262" Jul 23 21:26:35.642058 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:35.642011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerStarted","Data":"a67c96862b6702958525bac2d2d36872afee3be620eda8d1d0cab9024002e9d4"} Jul 23 21:26:35.661127 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:35.661081 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" podStartSLOduration=2.84198564 podStartE2EDuration="9.661063723s" totalImagesPullingTime="6.819078083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:35.660522395 +0000 UTC m=+48.800710532" watchObservedRunningTime="2026-07-23 21:26:35.661063723 +0000 UTC m=+48.801251885" Jul 23 21:26:38.604010 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:38.603968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:38.604029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:38.604088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604127 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604145 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604191 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604210 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:54.604190645 +0000 UTC m=+67.744378770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604215 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604226 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:54.604216721 +0000 UTC m=+67.744404851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:38.604485 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:38.604305 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:54.604283851 +0000 UTC m=+67.744471968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:48.575092 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:48.575063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nrfvl" Jul 23 21:26:53.116508 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.116466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:26:53.116508 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.116512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:53.119205 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.119184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:26:53.119284 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.119241 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:26:53.127510 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:53.127488 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:26:53.127583 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:53.127563 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:57.127543849 +0000 UTC m=+130.267731967 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : secret "metrics-daemon-secret" not found Jul 23 21:26:53.130570 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.130548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca3e117c-8409-4303-ab25-34e2e40350f6-original-pull-secret\") pod \"global-pull-secret-syncer-tfk45\" (UID: \"ca3e117c-8409-4303-ab25-34e2e40350f6\") " pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:53.217198 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.217142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:53.220067 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.220046 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:26:53.229983 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.229959 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:26:53.241358 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.241332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c8gd\" (UniqueName: \"kubernetes.io/projected/5952f7e7-a4de-4789-a580-76b2c6b78683-kube-api-access-4c8gd\") pod \"network-check-target-w2fgj\" (UID: \"5952f7e7-a4de-4789-a580-76b2c6b78683\") " pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:53.421432 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.421336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tfk45" Jul 23 21:26:53.430211 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.430184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:26:53.438024 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.437998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:53.551568 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.551520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tfk45"] Jul 23 21:26:53.554019 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:53.553993 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3e117c_8409_4303_ab25_34e2e40350f6.slice/crio-5c17defe82ead31542fff8aeb0fc68a675eeb88b0f1dff5024fd450246c9db8d WatchSource:0}: Error finding container 5c17defe82ead31542fff8aeb0fc68a675eeb88b0f1dff5024fd450246c9db8d: Status 404 returned error can't find the container with id 5c17defe82ead31542fff8aeb0fc68a675eeb88b0f1dff5024fd450246c9db8d Jul 23 21:26:53.567979 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.567954 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2fgj"] Jul 23 21:26:53.570509 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:26:53.570485 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5952f7e7_a4de_4789_a580_76b2c6b78683.slice/crio-3a5528cd399103621e53ef9a25c245cfeef91a2c4f5df5eaa404dc0f1ede4985 WatchSource:0}: Error finding container 3a5528cd399103621e53ef9a25c245cfeef91a2c4f5df5eaa404dc0f1ede4985: Status 404 returned error can't find the container with id 3a5528cd399103621e53ef9a25c245cfeef91a2c4f5df5eaa404dc0f1ede4985 Jul 23 21:26:53.691081 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.690983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2fgj" event={"ID":"5952f7e7-a4de-4789-a580-76b2c6b78683","Type":"ContainerStarted","Data":"3a5528cd399103621e53ef9a25c245cfeef91a2c4f5df5eaa404dc0f1ede4985"} Jul 23 21:26:53.692022 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:53.691996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfk45" event={"ID":"ca3e117c-8409-4303-ab25-34e2e40350f6","Type":"ContainerStarted","Data":"5c17defe82ead31542fff8aeb0fc68a675eeb88b0f1dff5024fd450246c9db8d"} Jul 23 21:26:54.628881 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:54.628834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:54.628905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:54.628946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629014 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629035 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629052 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629052 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:26.629093567 +0000 UTC m=+99.769281747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629138 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:26.629127156 +0000 UTC m=+99.769315276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:26:54.629424 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:26:54.629154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:26.629145951 +0000 UTC m=+99.769334069 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:26:58.712382 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:58.712277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tfk45" event={"ID":"ca3e117c-8409-4303-ab25-34e2e40350f6","Type":"ContainerStarted","Data":"af7598cbb120761f0c9e856b6771cac87597c97c3318aa9eaea23a7a21275c66"} Jul 23 21:26:58.713788 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:58.713761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2fgj" event={"ID":"5952f7e7-a4de-4789-a580-76b2c6b78683","Type":"ContainerStarted","Data":"d4d0fca1cbefe722b1f154ac6da179c56f1f8c9e9b8909bd9ba26c4a0fd4d39c"} Jul 23 21:26:58.713923 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:58.713899 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:26:58.727943 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:58.727893 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tfk45" podStartSLOduration=65.832282667 podStartE2EDuration="1m10.727876903s" totalImagesPullingTime="4.895594236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:58.726862445 +0000 UTC m=+71.867050580" watchObservedRunningTime="2026-07-23 21:26:58.727876903 +0000 UTC m=+71.868065084" Jul 23 21:26:58.741504 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:26:58.741457 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w2fgj" podStartSLOduration=65.864761877 podStartE2EDuration="1m10.741437395s" totalImagesPullingTime="4.876675518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:58.741163117 +0000 UTC m=+71.881351255" watchObservedRunningTime="2026-07-23 21:26:58.741437395 +0000 UTC m=+71.881625532" Jul 23 21:27:26.677835 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:27:26.677686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:27:26.677835 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:27:26.677765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:27:26.677835 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:27:26.677806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677868 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677907 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677922 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677931 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677946 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:30.677929166 +0000 UTC m=+163.818117280 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.677992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:30.677978344 +0000 UTC m=+163.818166474 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:27:26.678464 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:26.678013 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:30.677997622 +0000 UTC m=+163.818185741 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:27:29.720409 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:27:29.720377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w2fgj" Jul 23 21:27:57.215159 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:27:57.215093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:27:57.215664 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:57.215238 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:27:57.215664 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:27:57.215317 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:59.215299181 +0000 UTC m=+252.355487295 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : secret "metrics-daemon-secret" not found Jul 23 21:28:25.709314 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:25.709269 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" Jul 23 21:28:25.714369 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:25.714346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" podUID="90b4b78d-d7ef-4c6d-83dd-e300cdd89b90" Jul 23 21:28:25.723562 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:25.723526 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cxr59" podUID="68aefd2f-950d-4dbd-8761-0d77116dac38" Jul 23 21:28:25.956840 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:25.956809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:28:25.957021 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:25.956810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxr59" Jul 23 21:28:25.957021 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:25.956810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:28:26.414706 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:26.414655 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:28:30.768186 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:30.768151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:30.768207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:30.768250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768326 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768351 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768388 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls podName:68aefd2f-950d-4dbd-8761-0d77116dac38 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:32.768374554 +0000 UTC m=+285.908562694 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls") pod "dns-default-cxr59" (UID: "68aefd2f-950d-4dbd-8761-0d77116dac38") : secret "dns-default-metrics-tls" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768339 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768423 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66ffbd4c4f-hmsgl: secret "image-registry-tls" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768444 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert podName:90b4b78d-d7ef-4c6d-83dd-e300cdd89b90 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:32.768425919 +0000 UTC m=+285.908614033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-gxflc" (UID: "90b4b78d-d7ef-4c6d-83dd-e300cdd89b90") : secret "networking-console-plugin-cert" not found Jul 23 21:28:30.768612 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:28:30.768464 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls podName:5432d2a3-5b32-4523-adc5-1369ca354967 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:32.76845374 +0000 UTC m=+285.908641884 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls") pod "image-registry-66ffbd4c4f-hmsgl" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967") : secret "image-registry-tls" not found Jul 23 21:28:34.635582 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.635538 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" podUID="c6118498-3947-4ed3-899a-ca867b9a8e4e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused" Jul 23 21:28:34.984557 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.984522 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a353115-cfb1-475e-abaa-cfcadc2ae558" containerID="37b108e7d592140cdec42c59a79da005ab86ac6c2cea60be51df9da98d5ec5ec" exitCode=255 Jul 23 21:28:34.984728 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.984592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerDied","Data":"37b108e7d592140cdec42c59a79da005ab86ac6c2cea60be51df9da98d5ec5ec"} Jul 23 21:28:34.984971 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.984952 2578 scope.go:117] "RemoveContainer" containerID="37b108e7d592140cdec42c59a79da005ab86ac6c2cea60be51df9da98d5ec5ec" Jul 23 21:28:34.985939 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.985914 2578 generic.go:356] "Generic (PLEG): container finished" podID="c6118498-3947-4ed3-899a-ca867b9a8e4e" containerID="e4fe033cef058f1220af3ff8833a7f2f2161f4cc48e1058d353799843f10f6a3" exitCode=1 Jul 23 21:28:34.986042 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.985951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerDied","Data":"e4fe033cef058f1220af3ff8833a7f2f2161f4cc48e1058d353799843f10f6a3"} Jul 23 21:28:34.986318 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:34.986238 2578 scope.go:117] "RemoveContainer" containerID="e4fe033cef058f1220af3ff8833a7f2f2161f4cc48e1058d353799843f10f6a3" Jul 23 21:28:35.990718 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:35.990682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerStarted","Data":"3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8"} Jul 23 21:28:35.992389 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:35.992367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerStarted","Data":"f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4"} Jul 23 21:28:35.992628 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:35.992612 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:28:35.993220 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:35.993204 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:28:38.402444 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:28:38.402403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:29:53.133721 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.133687 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjbg2"] Jul 23 21:29:53.135685 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.135669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.138116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.138093 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 21:29:53.138249 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.138151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 21:29:53.139063 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.139047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 21:29:53.139110 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.139055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l265n\"" Jul 23 21:29:53.139110 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.139089 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 21:29:53.147724 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.147696 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjbg2"] Jul 23 21:29:53.197719 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.197692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.197898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.197791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a9c1f99-774e-433c-86ef-33a2476a0a0b-data-volume\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.197898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.197827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a9c1f99-774e-433c-86ef-33a2476a0a0b-crio-socket\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.197898 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.197874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bzr\" (UniqueName: \"kubernetes.io/projected/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-api-access-n8bzr\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.197998 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.197899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299209 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a9c1f99-774e-433c-86ef-33a2476a0a0b-data-volume\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a9c1f99-774e-433c-86ef-33a2476a0a0b-crio-socket\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bzr\" (UniqueName: \"kubernetes.io/projected/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-api-access-n8bzr\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299378 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.299300 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.299378 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299602 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.299384 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.799363907 +0000 UTC m=+246.939552040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.299602 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299386 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7a9c1f99-774e-433c-86ef-33a2476a0a0b-crio-socket\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.299602 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.299397 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.299602 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.299456 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.799441214 +0000 UTC m=+246.939629330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.299736 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.299631 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a9c1f99-774e-433c-86ef-33a2476a0a0b-data-volume\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.322714 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.322680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bzr\" (UniqueName: \"kubernetes.io/projected/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-api-access-n8bzr\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.802507 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.802465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.802713 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:53.802583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:53.802713 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.802596 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.802713 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.802671 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.802654539 +0000 UTC m=+247.942842653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.802713 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.802702 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.802919 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:53.802781 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.802765422 +0000 UTC m=+247.942953551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.810645 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:54.810609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:54.811078 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:54.810659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:54.811078 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:54.810736 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:54.811078 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:54.810775 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.811078 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:54.810813 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.810799283 +0000 UTC m=+249.950987398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : configmap "kube-rbac-proxy" not found Jul 23 21:29:54.811078 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:54.810833 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.810820926 +0000 UTC m=+249.951009039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:55.335201 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:55.335175 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tcpqb_3544c995-cd90-4090-b348-6199ea1e7c1a/dns-node-resolver/0.log" Jul 23 21:29:56.334164 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:56.334137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxndw_3e4a2940-4a7f-4876-9037-b065fdec7803/node-ca/0.log" Jul 23 21:29:56.829101 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:56.829058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:56.829281 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:56.829112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:29:56.829281 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:56.829216 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:56.829281 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:56.829219 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:56.829401 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:56.829283 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.82926634 +0000 UTC m=+253.969454454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:56.829401 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:56.829303 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.829292519 +0000 UTC m=+253.969480632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : configmap "kube-rbac-proxy" not found Jul 23 21:29:57.134026 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:57.133942 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jg45h_56720bc5-45d5-48fd-956e-b8c2336efcdb/serve-healthcheck-canary/0.log" Jul 23 21:29:59.247196 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:29:59.247159 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:29:59.247664 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:59.247313 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:29:59.247664 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:29:59.247383 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs podName:6af2c0e1-2bc9-430b-b8fe-414a6af6fe18 nodeName:}" failed. No retries permitted until 2026-07-23 21:32:01.247366605 +0000 UTC m=+374.387554721 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs") pod "network-metrics-daemon-jmbts" (UID: "6af2c0e1-2bc9-430b-b8fe-414a6af6fe18") : secret "metrics-daemon-secret" not found Jul 23 21:30:00.861287 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:00.861241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:00.861659 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:00.861297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:00.861659 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:00.861388 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:30:00.861659 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:00.861405 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:30:00.861659 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:00.861448 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.861434003 +0000 UTC m=+262.001622117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : secret "insights-runtime-extractor-tls" not found Jul 23 21:30:00.861659 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:00.861462 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm podName:7a9c1f99-774e-433c-86ef-33a2476a0a0b nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.861455804 +0000 UTC m=+262.001643918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mjbg2" (UID: "7a9c1f99-774e-433c-86ef-33a2476a0a0b") : configmap "kube-rbac-proxy" not found Jul 23 21:30:08.933960 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:08.933907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:08.934374 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:08.934007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:08.934547 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:08.934525 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7a9c1f99-774e-433c-86ef-33a2476a0a0b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:08.936200 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:08.936182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7a9c1f99-774e-433c-86ef-33a2476a0a0b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjbg2\" (UID: \"7a9c1f99-774e-433c-86ef-33a2476a0a0b\") " pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:09.044807 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:09.044694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjbg2" Jul 23 21:30:09.166404 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:09.166378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjbg2"] Jul 23 21:30:09.168971 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:30:09.168946 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9c1f99_774e_433c_86ef_33a2476a0a0b.slice/crio-2a3c5ab7d07da454cd3d3779205548c87c4565f245b759551ea3345c7beda17f WatchSource:0}: Error finding container 2a3c5ab7d07da454cd3d3779205548c87c4565f245b759551ea3345c7beda17f: Status 404 returned error can't find the container with id 2a3c5ab7d07da454cd3d3779205548c87c4565f245b759551ea3345c7beda17f Jul 23 21:30:09.254758 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:09.254721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjbg2" event={"ID":"7a9c1f99-774e-433c-86ef-33a2476a0a0b","Type":"ContainerStarted","Data":"2a3c5ab7d07da454cd3d3779205548c87c4565f245b759551ea3345c7beda17f"} Jul 23 21:30:14.275757 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:14.275710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjbg2" event={"ID":"7a9c1f99-774e-433c-86ef-33a2476a0a0b","Type":"ContainerStarted","Data":"af0bd9389b3f4db2a55288077f4d1545d8c373b30601195bc516fccbfd0f7c68"} Jul 23 21:30:18.291667 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:18.291624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjbg2" event={"ID":"7a9c1f99-774e-433c-86ef-33a2476a0a0b","Type":"ContainerStarted","Data":"23f8bb81fbc690e77075f3114e562d57bb1447cc4e8252814abe892d021d47fd"} Jul 23 21:30:21.302896 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:21.302798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjbg2" event={"ID":"7a9c1f99-774e-433c-86ef-33a2476a0a0b","Type":"ContainerStarted","Data":"6d9f4446499099896ab14d988fcc58e4120d55717312cf2d046fadfdf76c1223"} Jul 23 21:30:21.321090 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:21.321038 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjbg2" podStartSLOduration=16.546674773 podStartE2EDuration="28.321023031s" totalImagesPullingTime="11.774348258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:29:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:21.320247295 +0000 UTC m=+274.460435424" watchObservedRunningTime="2026-07-23 21:30:21.321023031 +0000 UTC m=+274.461211168" Jul 23 21:30:26.981867 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:26.981826 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" podUID="b3016735-b759-4397-87cd-df8e35c82be1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 21:30:28.957911 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:28.957865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cxr59" podUID="68aefd2f-950d-4dbd-8761-0d77116dac38" Jul 23 21:30:28.957911 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:28.957865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" Jul 23 21:30:28.958313 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:28.957865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" podUID="90b4b78d-d7ef-4c6d-83dd-e300cdd89b90" Jul 23 21:30:29.328176 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:29.328148 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:29.328334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:29.328149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:30:29.328334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:29.328149 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:30:31.906211 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.906156 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vwncj"] Jul 23 21:30:31.911525 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.911497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:31.913936 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.913915 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tbsf8\"" Jul 23 21:30:31.914156 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.914137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 21:30:31.914245 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.914156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 21:30:31.914308 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.914250 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 21:30:31.914308 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.914277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 21:30:31.915120 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.915098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 21:30:31.915205 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:31.915109 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 21:30:32.019223 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-root\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019223 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-textfile\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019451 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-tls\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019451 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019451 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-wtmp\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019451 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019451 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56m98\" (UniqueName: \"kubernetes.io/projected/0100c587-2589-4d19-be2f-a0a433ce3585-kube-api-access-56m98\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019601 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-sys\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.019601 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.019508 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-metrics-client-ca\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120612 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-root\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120612 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-textfile\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-tls\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120698 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-root\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-wtmp\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.120874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-wtmp\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56m98\" (UniqueName: \"kubernetes.io/projected/0100c587-2589-4d19-be2f-a0a433ce3585-kube-api-access-56m98\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.120999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-textfile\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.121028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-sys\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121116 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.121052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-metrics-client-ca\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121362 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.121127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0100c587-2589-4d19-be2f-a0a433ce3585-sys\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121502 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.121474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.121623 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.121541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0100c587-2589-4d19-be2f-a0a433ce3585-metrics-client-ca\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.123120 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.123101 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-tls\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.123222 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.123202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0100c587-2589-4d19-be2f-a0a433ce3585-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.129229 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.129199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56m98\" (UniqueName: \"kubernetes.io/projected/0100c587-2589-4d19-be2f-a0a433ce3585-kube-api-access-56m98\") pod \"node-exporter-vwncj\" (UID: \"0100c587-2589-4d19-be2f-a0a433ce3585\") " pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.220262 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.220169 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vwncj" Jul 23 21:30:32.230643 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:30:32.230614 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0100c587_2589_4d19_be2f_a0a433ce3585.slice/crio-d2912ef9edf4f2f1bb8f359e26b45004d529244bd9c82faad66bf9d89e4bb3ea WatchSource:0}: Error finding container d2912ef9edf4f2f1bb8f359e26b45004d529244bd9c82faad66bf9d89e4bb3ea: Status 404 returned error can't find the container with id d2912ef9edf4f2f1bb8f359e26b45004d529244bd9c82faad66bf9d89e4bb3ea Jul 23 21:30:32.339111 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.339068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwncj" event={"ID":"0100c587-2589-4d19-be2f-a0a433ce3585","Type":"ContainerStarted","Data":"d2912ef9edf4f2f1bb8f359e26b45004d529244bd9c82faad66bf9d89e4bb3ea"} Jul 23 21:30:32.827134 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.827095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:32.827319 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.827175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:30:32.827319 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.827240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:30:32.830018 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.829992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68aefd2f-950d-4dbd-8761-0d77116dac38-metrics-tls\") pod \"dns-default-cxr59\" (UID: \"68aefd2f-950d-4dbd-8761-0d77116dac38\") " pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:32.830152 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.830116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"image-registry-66ffbd4c4f-hmsgl\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:30:32.830216 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.830166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/90b4b78d-d7ef-4c6d-83dd-e300cdd89b90-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-gxflc\" (UID: \"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:30:32.932772 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.932698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vbp4r\"" Jul 23 21:30:32.933262 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.932780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:30:32.933262 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.932713 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8zssn\"" Jul 23 21:30:32.940126 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.940101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" Jul 23 21:30:32.940279 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.940127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:30:32.940279 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:32.940229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:33.099195 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.099015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:30:33.124309 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.124175 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc"] Jul 23 21:30:33.216516 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:30:33.216483 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5432d2a3_5b32_4523_adc5_1369ca354967.slice/crio-a0ac45f824bfa85bfaee34959a9c433e9f5503cdf762835d8a32280f721da9e2 WatchSource:0}: Error finding container a0ac45f824bfa85bfaee34959a9c433e9f5503cdf762835d8a32280f721da9e2: Status 404 returned error can't find the container with id a0ac45f824bfa85bfaee34959a9c433e9f5503cdf762835d8a32280f721da9e2 Jul 23 21:30:33.217224 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:30:33.217200 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b4b78d_d7ef_4c6d_83dd_e300cdd89b90.slice/crio-d8350a6f9341f6f2c133d2c4d9f3eb566de60f90750820c90d58f844f3aa522e WatchSource:0}: Error finding container d8350a6f9341f6f2c133d2c4d9f3eb566de60f90750820c90d58f844f3aa522e: Status 404 returned error can't find the container with id d8350a6f9341f6f2c133d2c4d9f3eb566de60f90750820c90d58f844f3aa522e Jul 23 21:30:33.345347 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.345317 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cxr59"] Jul 23 21:30:33.345979 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.345947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" event={"ID":"5432d2a3-5b32-4523-adc5-1369ca354967","Type":"ContainerStarted","Data":"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f"} Jul 23 21:30:33.346122 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.346006 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:30:33.346122 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.346026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" event={"ID":"5432d2a3-5b32-4523-adc5-1369ca354967","Type":"ContainerStarted","Data":"a0ac45f824bfa85bfaee34959a9c433e9f5503cdf762835d8a32280f721da9e2"} Jul 23 21:30:33.347410 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.347382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" event={"ID":"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90","Type":"ContainerStarted","Data":"d8350a6f9341f6f2c133d2c4d9f3eb566de60f90750820c90d58f844f3aa522e"} Jul 23 21:30:33.349129 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.349104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwncj" event={"ID":"0100c587-2589-4d19-be2f-a0a433ce3585","Type":"ContainerStarted","Data":"2cfd3786be97bdd69ca008c1c869e44010ba29abacafff453911b911da21162b"} Jul 23 21:30:33.349566 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:30:33.349515 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68aefd2f_950d_4dbd_8761_0d77116dac38.slice/crio-66f46e21a3fe4177a5cd2582cb23d24088101b960d8e10c60312f016d643afd9 WatchSource:0}: Error finding container 66f46e21a3fe4177a5cd2582cb23d24088101b960d8e10c60312f016d643afd9: Status 404 returned error can't find the container with id 66f46e21a3fe4177a5cd2582cb23d24088101b960d8e10c60312f016d643afd9 Jul 23 21:30:33.387579 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:33.387527 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" podStartSLOduration=285.387509062 podStartE2EDuration="4m45.387509062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:33.386301087 +0000 UTC m=+286.526489247" watchObservedRunningTime="2026-07-23 21:30:33.387509062 +0000 UTC m=+286.527697198" Jul 23 21:30:34.356566 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:34.356513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" event={"ID":"90b4b78d-d7ef-4c6d-83dd-e300cdd89b90","Type":"ContainerStarted","Data":"628e22ffdbd14dcbcb953e828d9b55cd4cb610e33318a6a075a69a7416896692"} Jul 23 21:30:34.358208 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:34.358184 2578 generic.go:356] "Generic (PLEG): container finished" podID="0100c587-2589-4d19-be2f-a0a433ce3585" containerID="2cfd3786be97bdd69ca008c1c869e44010ba29abacafff453911b911da21162b" exitCode=0 Jul 23 21:30:34.358319 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:34.358259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwncj" event={"ID":"0100c587-2589-4d19-be2f-a0a433ce3585","Type":"ContainerDied","Data":"2cfd3786be97bdd69ca008c1c869e44010ba29abacafff453911b911da21162b"} Jul 23 21:30:34.359613 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:34.359584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxr59" event={"ID":"68aefd2f-950d-4dbd-8761-0d77116dac38","Type":"ContainerStarted","Data":"66f46e21a3fe4177a5cd2582cb23d24088101b960d8e10c60312f016d643afd9"} Jul 23 21:30:34.371384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:34.371344 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-gxflc" podStartSLOduration=284.412729884 podStartE2EDuration="4m45.371328502s" totalImagesPullingTime="958.598618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:34.37078603 +0000 UTC m=+287.510974168" watchObservedRunningTime="2026-07-23 21:30:34.371328502 +0000 UTC m=+287.511516638" Jul 23 21:30:35.369412 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:35.369312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwncj" event={"ID":"0100c587-2589-4d19-be2f-a0a433ce3585","Type":"ContainerStarted","Data":"b58de3d1614d41b17486b357e82b5acc011eed372c3f779d87891dc0efd8d5af"} Jul 23 21:30:35.369868 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:35.369417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwncj" event={"ID":"0100c587-2589-4d19-be2f-a0a433ce3585","Type":"ContainerStarted","Data":"de8a9a08e9249fdb47c2ee37f6736d30543d8d405279e8700073b322788b7c9f"} Jul 23 21:30:35.392333 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:35.392271 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vwncj" podStartSLOduration=3.311798019 podStartE2EDuration="4.392252457s" totalImagesPullingTime="1.01210616s" totalInitContainerRuntime="68.348278ms" isStatefulPod=true podCreationTimestamp="2026-07-23 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:35.390422517 +0000 UTC m=+288.530610658" watchObservedRunningTime="2026-07-23 21:30:35.392252457 +0000 UTC m=+288.532440602" Jul 23 21:30:35.993620 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:35.993583 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" podUID="c6118498-3947-4ed3-899a-ca867b9a8e4e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused" Jul 23 21:30:36.374327 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.374236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxr59" event={"ID":"68aefd2f-950d-4dbd-8761-0d77116dac38","Type":"ContainerStarted","Data":"1c4e3c3596153766511e4aa4bcb897806078754f5474152b7526482b1d1e11f9"} Jul 23 21:30:36.374327 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.374291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cxr59" event={"ID":"68aefd2f-950d-4dbd-8761-0d77116dac38","Type":"ContainerStarted","Data":"652bd27f6809f95047daa580734785fe2b8c36d8111a1c0e59fda204201c66db"} Jul 23 21:30:36.374773 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.374343 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:36.375920 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.375899 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a353115-cfb1-475e-abaa-cfcadc2ae558" containerID="3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8" exitCode=255 Jul 23 21:30:36.376030 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.375964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerDied","Data":"3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8"} Jul 23 21:30:36.376030 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.376002 2578 scope.go:117] "RemoveContainer" containerID="37b108e7d592140cdec42c59a79da005ab86ac6c2cea60be51df9da98d5ec5ec" Jul 23 21:30:36.376313 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.376292 2578 scope.go:117] "RemoveContainer" containerID="3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8" Jul 23 21:30:36.376479 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:36.376454 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-684b4fb788-9rg88_open-cluster-management-agent-addon(8a353115-cfb1-475e-abaa-cfcadc2ae558)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" podUID="8a353115-cfb1-475e-abaa-cfcadc2ae558" Jul 23 21:30:36.377830 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.377799 2578 generic.go:356] "Generic (PLEG): container finished" podID="c6118498-3947-4ed3-899a-ca867b9a8e4e" containerID="f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4" exitCode=1 Jul 23 21:30:36.377913 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.377835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerDied","Data":"f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4"} Jul 23 21:30:36.378115 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.378100 2578 scope.go:117] "RemoveContainer" containerID="f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4" Jul 23 21:30:36.378270 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:36.378250 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-846d8c66b7-75qp4_open-cluster-management-agent-addon(c6118498-3947-4ed3-899a-ca867b9a8e4e)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" podUID="c6118498-3947-4ed3-899a-ca867b9a8e4e" Jul 23 21:30:36.386517 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.386500 2578 scope.go:117] "RemoveContainer" containerID="e4fe033cef058f1220af3ff8833a7f2f2161f4cc48e1058d353799843f10f6a3" Jul 23 21:30:36.390712 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.390666 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cxr59" podStartSLOduration=252.239263065 podStartE2EDuration="4m14.390649756s" totalImagesPullingTime="2.151386691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:36.390534834 +0000 UTC m=+289.530722970" watchObservedRunningTime="2026-07-23 21:30:36.390649756 +0000 UTC m=+289.530837894" Jul 23 21:30:36.965851 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.965790 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" Jul 23 21:30:36.971570 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.971547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:30:36.982101 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:36.982071 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" podUID="b3016735-b759-4397-87cd-df8e35c82be1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 21:30:37.383157 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:37.383127 2578 scope.go:117] "RemoveContainer" containerID="3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8" Jul 23 21:30:37.383566 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:37.383327 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-684b4fb788-9rg88_open-cluster-management-agent-addon(8a353115-cfb1-475e-abaa-cfcadc2ae558)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" podUID="8a353115-cfb1-475e-abaa-cfcadc2ae558" Jul 23 21:30:37.384390 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:37.384365 2578 scope.go:117] "RemoveContainer" containerID="f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4" Jul 23 21:30:37.384537 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:37.384518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-846d8c66b7-75qp4_open-cluster-management-agent-addon(c6118498-3947-4ed3-899a-ca867b9a8e4e)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" podUID="c6118498-3947-4ed3-899a-ca867b9a8e4e" Jul 23 21:30:41.403836 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:30:41.403792 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jmbts" podUID="6af2c0e1-2bc9-430b-b8fe-414a6af6fe18" Jul 23 21:30:45.993019 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:45.992986 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:30:45.993488 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:45.993373 2578 scope.go:117] "RemoveContainer" containerID="f6deda699b2cf4d617fad69befd67de7c19429807cbce187ee567c35f1ca68d4" Jul 23 21:30:46.387292 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.387202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cxr59" Jul 23 21:30:46.421091 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.421056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" event={"ID":"c6118498-3947-4ed3-899a-ca867b9a8e4e","Type":"ContainerStarted","Data":"ee16bbe1963e888c492e004882e9b398cca0d52b8669bb98af348466611f5acd"} Jul 23 21:30:46.421415 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.421391 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:30:46.422536 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.422516 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846d8c66b7-75qp4" Jul 23 21:30:46.981836 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.981789 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" podUID="b3016735-b759-4397-87cd-df8e35c82be1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 23 21:30:46.981988 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.981881 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" Jul 23 21:30:46.982346 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.982318 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a67c96862b6702958525bac2d2d36872afee3be620eda8d1d0cab9024002e9d4"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 23 21:30:46.982383 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:46.982366 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" podUID="b3016735-b759-4397-87cd-df8e35c82be1" containerName="service-proxy" containerID="cri-o://a67c96862b6702958525bac2d2d36872afee3be620eda8d1d0cab9024002e9d4" gracePeriod=30 Jul 23 21:30:47.282123 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:47.282048 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 21:30:47.426946 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:47.426785 2578 generic.go:356] "Generic (PLEG): container finished" podID="b3016735-b759-4397-87cd-df8e35c82be1" containerID="a67c96862b6702958525bac2d2d36872afee3be620eda8d1d0cab9024002e9d4" exitCode=2 Jul 23 21:30:47.426946 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:47.426858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerDied","Data":"a67c96862b6702958525bac2d2d36872afee3be620eda8d1d0cab9024002e9d4"} Jul 23 21:30:47.426946 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:47.426906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cd4c74c8c-l5n9z" event={"ID":"b3016735-b759-4397-87cd-df8e35c82be1","Type":"ContainerStarted","Data":"0254264ac438e629f923a1c4bbb71b3218fcb7c0802af5d4e07c576994875a24"} Jul 23 21:30:48.403176 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:48.403138 2578 scope.go:117] "RemoveContainer" containerID="3951d18809d509e93192c5127c5cf058fbdbc7b4d4b68a50a37befc06672dab8" Jul 23 21:30:49.091721 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:49.091688 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:30:49.096212 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:49.096184 2578 patch_prober.go:28] interesting pod/image-registry-66ffbd4c4f-hmsgl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:49.096348 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:49.096244 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:49.436079 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:49.435995 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684b4fb788-9rg88" event={"ID":"8a353115-cfb1-475e-abaa-cfcadc2ae558","Type":"ContainerStarted","Data":"4a1c0a3bd0889b8f3297bf7335253f32c9db10d6dbd5b207681ae1542fc433bd"} Jul 23 21:30:53.403096 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:53.403059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:30:59.095976 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:30:59.095938 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:31:09.827006 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:09.826976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxr59_68aefd2f-950d-4dbd-8761-0d77116dac38/dns/0.log" Jul 23 21:31:10.041734 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:10.041701 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxr59_68aefd2f-950d-4dbd-8761-0d77116dac38/kube-rbac-proxy/0.log" Jul 23 21:31:10.626568 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:10.626537 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tcpqb_3544c995-cd90-4090-b348-6199ea1e7c1a/dns-node-resolver/0.log" Jul 23 21:31:11.426431 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:11.426399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jg45h_56720bc5-45d5-48fd-956e-b8c2336efcdb/serve-healthcheck-canary/0.log" Jul 23 21:31:14.111182 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.111121 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" containerName="registry" containerID="cri-o://363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f" gracePeriod=30 Jul 23 21:31:14.349590 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.349563 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:31:14.422144 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422059 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn2rd\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422144 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422095 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422144 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422131 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422413 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422180 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422413 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422210 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422413 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422237 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422413 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422413 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422328 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets\") pod \"5432d2a3-5b32-4523-adc5-1369ca354967\" (UID: \"5432d2a3-5b32-4523-adc5-1369ca354967\") " Jul 23 21:31:14.422695 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422665 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:14.422854 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.422714 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:14.424797 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.424725 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:14.424908 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.424796 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd" (OuterVolumeSpecName: "kube-api-access-qn2rd") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "kube-api-access-qn2rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:14.425076 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.425035 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:14.425180 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.425130 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:14.425180 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.425153 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:14.431652 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.431630 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5432d2a3-5b32-4523-adc5-1369ca354967" (UID: "5432d2a3-5b32-4523-adc5-1369ca354967"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:31:14.522840 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522806 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-bound-sa-token\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.522840 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522838 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-installation-pull-secrets\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522854 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn2rd\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-kube-api-access-qn2rd\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522866 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-trusted-ca\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522878 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5432d2a3-5b32-4523-adc5-1369ca354967-ca-trust-extracted\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522891 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5432d2a3-5b32-4523-adc5-1369ca354967-registry-certificates\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522904 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5432d2a3-5b32-4523-adc5-1369ca354967-image-registry-private-configuration\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522918 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5432d2a3-5b32-4523-adc5-1369ca354967-registry-tls\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522925 2578 generic.go:356] "Generic (PLEG): container finished" podID="5432d2a3-5b32-4523-adc5-1369ca354967" containerID="363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f" exitCode=0 Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" event={"ID":"5432d2a3-5b32-4523-adc5-1369ca354967","Type":"ContainerDied","Data":"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f"} Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.522970 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.523002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66ffbd4c4f-hmsgl" event={"ID":"5432d2a3-5b32-4523-adc5-1369ca354967","Type":"ContainerDied","Data":"a0ac45f824bfa85bfaee34959a9c433e9f5503cdf762835d8a32280f721da9e2"} Jul 23 21:31:14.523025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.523023 2578 scope.go:117] "RemoveContainer" containerID="363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f" Jul 23 21:31:14.531368 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.531350 2578 scope.go:117] "RemoveContainer" containerID="363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f" Jul 23 21:31:14.531621 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:31:14.531602 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f\": container with ID starting with 363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f not found: ID does not exist" containerID="363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f" Jul 23 21:31:14.531676 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.531629 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f"} err="failed to get container status \"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f\": rpc error: code = NotFound desc = could not find container \"363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f\": container with ID starting with 363134f0ce2d4f90b7b5f8b2071ac99f081a3f9c089feafdb8cae43f22bdfe9f not found: ID does not exist" Jul 23 21:31:14.542841 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.542819 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:31:14.546789 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:14.546768 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66ffbd4c4f-hmsgl"] Jul 23 21:31:15.409874 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:31:15.409823 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" path="/var/lib/kubelet/pods/5432d2a3-5b32-4523-adc5-1369ca354967/volumes" Jul 23 21:32:01.264819 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.264771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:32:01.267072 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.267039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6af2c0e1-2bc9-430b-b8fe-414a6af6fe18-metrics-certs\") pod \"network-metrics-daemon-jmbts\" (UID: \"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18\") " pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:32:01.507114 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.507081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:32:01.515047 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.514993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jmbts" Jul 23 21:32:01.638139 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.638099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jmbts"] Jul 23 21:32:01.641201 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:32:01.641158 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af2c0e1_2bc9_430b_b8fe_414a6af6fe18.slice/crio-d16c6511efbc4e8a881b005ee69e670e9a611f3fdd8aac9f34885339a36b9b7d WatchSource:0}: Error finding container d16c6511efbc4e8a881b005ee69e670e9a611f3fdd8aac9f34885339a36b9b7d: Status 404 returned error can't find the container with id d16c6511efbc4e8a881b005ee69e670e9a611f3fdd8aac9f34885339a36b9b7d Jul 23 21:32:01.643100 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.643084 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:32:01.682867 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:01.682826 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmbts" event={"ID":"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18","Type":"ContainerStarted","Data":"d16c6511efbc4e8a881b005ee69e670e9a611f3fdd8aac9f34885339a36b9b7d"} Jul 23 21:32:02.688637 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:02.688597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmbts" event={"ID":"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18","Type":"ContainerStarted","Data":"40a2eec2d25dcd59cfb023a6ab0725f36d1e341977a0fb0ee387502e3e64d09a"} Jul 23 21:32:03.693615 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:03.693583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jmbts" event={"ID":"6af2c0e1-2bc9-430b-b8fe-414a6af6fe18","Type":"ContainerStarted","Data":"a0081747db4533af4e2a4bb203fa46ef4a7c28b19e04a63a3fb7e81dcfce239f"} Jul 23 21:32:03.711590 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:32:03.711540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jmbts" podStartSLOduration=374.774268943 podStartE2EDuration="6m15.711524342s" totalImagesPullingTime="937.255399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:32:03.710629304 +0000 UTC m=+376.850817442" watchObservedRunningTime="2026-07-23 21:32:03.711524342 +0000 UTC m=+376.851712477" Jul 23 21:34:58.313928 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.313887 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dnmr8"] Jul 23 21:34:58.314334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.314167 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" containerName="registry" Jul 23 21:34:58.314334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.314182 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" containerName="registry" Jul 23 21:34:58.314334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.314246 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5432d2a3-5b32-4523-adc5-1369ca354967" containerName="registry" Jul 23 21:34:58.315860 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.315843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.318833 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.318811 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 21:34:58.318977 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.318865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 21:34:58.319463 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.319446 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2mfd9\"" Jul 23 21:34:58.327345 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.327325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dnmr8"] Jul 23 21:34:58.384121 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.384082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.384121 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.384125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425cl\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-kube-api-access-425cl\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.485218 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.485179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.485411 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.485226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425cl\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-kube-api-access-425cl\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.496543 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.496508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-bound-sa-token\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.496685 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.496623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425cl\" (UniqueName: \"kubernetes.io/projected/24353f8c-d7ff-4d45-bee1-439e01e908b6-kube-api-access-425cl\") pod \"cert-manager-55b4d954d5-dnmr8\" (UID: \"24353f8c-d7ff-4d45-bee1-439e01e908b6\") " pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.624777 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.624665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dnmr8" Jul 23 21:34:58.752032 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:58.751987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dnmr8"] Jul 23 21:34:58.755588 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:34:58.755560 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24353f8c_d7ff_4d45_bee1_439e01e908b6.slice/crio-4eba9a177e15384145fe1cf0aa377690932409d93cf598ac97d2d0d49a433aa8 WatchSource:0}: Error finding container 4eba9a177e15384145fe1cf0aa377690932409d93cf598ac97d2d0d49a433aa8: Status 404 returned error can't find the container with id 4eba9a177e15384145fe1cf0aa377690932409d93cf598ac97d2d0d49a433aa8 Jul 23 21:34:59.258240 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:34:59.258196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dnmr8" event={"ID":"24353f8c-d7ff-4d45-bee1-439e01e908b6","Type":"ContainerStarted","Data":"4eba9a177e15384145fe1cf0aa377690932409d93cf598ac97d2d0d49a433aa8"} Jul 23 21:35:02.271472 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:02.271434 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dnmr8" event={"ID":"24353f8c-d7ff-4d45-bee1-439e01e908b6","Type":"ContainerStarted","Data":"67e786c406bf03402551c69372e700d8861d5bbfd7dd04ac9488163a5fcd4cdf"} Jul 23 21:35:02.288371 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:02.288319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dnmr8" podStartSLOduration=1.490729141 podStartE2EDuration="4.288306147s" totalImagesPullingTime="2.797577006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:02.287220676 +0000 UTC m=+555.427408814" watchObservedRunningTime="2026-07-23 21:35:02.288306147 +0000 UTC m=+555.428494283" Jul 23 21:35:20.580177 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.580129 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp"] Jul 23 21:35:20.586504 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.586484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.589264 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.589241 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 21:35:20.589958 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.589939 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 21:35:20.590048 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.589985 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 21:35:20.590654 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.590638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlkxg\"" Jul 23 21:35:20.590733 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.590689 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 21:35:20.597961 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.597941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp"] Jul 23 21:35:20.749895 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.749859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.750061 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.749913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.750061 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.749939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nhz2\" (UniqueName: \"kubernetes.io/projected/717b6b90-c2f8-402a-a353-fa868d28545d-kube-api-access-5nhz2\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.750061 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.750000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.750061 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.750030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851206 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851206 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851336 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nhz2\" (UniqueName: \"kubernetes.io/projected/717b6b90-c2f8-402a-a353-fa868d28545d-kube-api-access-5nhz2\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851336 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851336 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.851623 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.851595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.853538 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.853509 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717b6b90-c2f8-402a-a353-fa868d28545d-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.853670 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.853650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.853739 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.853720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/717b6b90-c2f8-402a-a353-fa868d28545d-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.859712 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.859692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nhz2\" (UniqueName: \"kubernetes.io/projected/717b6b90-c2f8-402a-a353-fa868d28545d-kube-api-access-5nhz2\") pod \"opendatahub-operator-controller-manager-75db77d775-l57rp\" (UID: \"717b6b90-c2f8-402a-a353-fa868d28545d\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:20.896645 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:20.896612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:21.032157 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:21.032107 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp"] Jul 23 21:35:21.035473 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:35:21.035435 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717b6b90_c2f8_402a_a353_fa868d28545d.slice/crio-715459cc32422f4dc06b1afbc82f99e6b41675adc3b5c7e46bfa4520af5f9b35 WatchSource:0}: Error finding container 715459cc32422f4dc06b1afbc82f99e6b41675adc3b5c7e46bfa4520af5f9b35: Status 404 returned error can't find the container with id 715459cc32422f4dc06b1afbc82f99e6b41675adc3b5c7e46bfa4520af5f9b35 Jul 23 21:35:21.336904 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:21.336861 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" event={"ID":"717b6b90-c2f8-402a-a353-fa868d28545d","Type":"ContainerStarted","Data":"715459cc32422f4dc06b1afbc82f99e6b41675adc3b5c7e46bfa4520af5f9b35"} Jul 23 21:35:24.350960 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:24.350921 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" event={"ID":"717b6b90-c2f8-402a-a353-fa868d28545d","Type":"ContainerStarted","Data":"1dbb3505f999d5a088bc4156b97171c8eba162dac7a0be8006152f2253c86d10"} Jul 23 21:35:25.356342 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:25.356307 2578 generic.go:356] "Generic (PLEG): container finished" podID="717b6b90-c2f8-402a-a353-fa868d28545d" containerID="1dbb3505f999d5a088bc4156b97171c8eba162dac7a0be8006152f2253c86d10" exitCode=0 Jul 23 21:35:25.356725 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:25.356361 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" event={"ID":"717b6b90-c2f8-402a-a353-fa868d28545d","Type":"ContainerDied","Data":"1dbb3505f999d5a088bc4156b97171c8eba162dac7a0be8006152f2253c86d10"} Jul 23 21:35:26.362344 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:26.362303 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" event={"ID":"717b6b90-c2f8-402a-a353-fa868d28545d","Type":"ContainerStarted","Data":"74a25da6a4670de3138ca66af09e393ec452af8f95d92e97ff9e5e2a77906676"} Jul 23 21:35:26.362732 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:26.362463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:26.384503 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:26.384444 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" podStartSLOduration=1.88693666 podStartE2EDuration="6.384427462s" totalImagesPullingTime="3.460670433s" totalInitContainerRuntime="1.036820369s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:26.384168818 +0000 UTC m=+579.524356965" watchObservedRunningTime="2026-07-23 21:35:26.384427462 +0000 UTC m=+579.524615597" Jul 23 21:35:37.368072 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:37.368041 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-l57rp" Jul 23 21:35:40.846933 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.846895 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb"] Jul 23 21:35:40.849181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.849160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:40.853526 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.853483 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wpt8w\"" Jul 23 21:35:40.853526 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.853508 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 21:35:40.854028 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.854015 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 21:35:40.854243 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.854225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 21:35:40.854653 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.854634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 21:35:40.873767 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.873693 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb"] Jul 23 21:35:40.991307 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.991268 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tp4v9"] Jul 23 21:35:40.993882 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.993862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:40.998240 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.998218 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 23 21:35:40.998365 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:40.998291 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gw4nh\"" Jul 23 21:35:41.004206 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.004172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tmp\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.004206 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.004206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.004386 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.004271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw74t\" (UniqueName: \"kubernetes.io/projected/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-kube-api-access-tw74t\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.012268 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.012244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tp4v9"] Jul 23 21:35:41.104880 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.104786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw74t\" (UniqueName: \"kubernetes.io/projected/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-kube-api-access-tw74t\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.104880 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.104836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a24372c-3a6b-4360-a297-329398490dec-cert\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.104880 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.104855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tv8l\" (UniqueName: \"kubernetes.io/projected/5a24372c-3a6b-4360-a297-329398490dec-kube-api-access-9tv8l\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.105104 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.104920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tmp\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.105104 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.104951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.107108 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.107085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tmp\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.107494 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.107474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.130183 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.130149 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw74t\" (UniqueName: \"kubernetes.io/projected/99eb8b5a-4fc0-45d9-9bf8-289c0197792a-kube-api-access-tw74t\") pod \"kube-auth-proxy-5b88774c5c-2gbcb\" (UID: \"99eb8b5a-4fc0-45d9-9bf8-289c0197792a\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.158902 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.158868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" Jul 23 21:35:41.205699 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.205666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a24372c-3a6b-4360-a297-329398490dec-cert\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.205699 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.205705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tv8l\" (UniqueName: \"kubernetes.io/projected/5a24372c-3a6b-4360-a297-329398490dec-kube-api-access-9tv8l\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.208578 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.208553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a24372c-3a6b-4360-a297-329398490dec-cert\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.219472 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.219439 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tv8l\" (UniqueName: \"kubernetes.io/projected/5a24372c-3a6b-4360-a297-329398490dec-kube-api-access-9tv8l\") pod \"odh-model-controller-7998c67dc4-tp4v9\" (UID: \"5a24372c-3a6b-4360-a297-329398490dec\") " pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.297122 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.297089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb"] Jul 23 21:35:41.300096 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:35:41.300067 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eb8b5a_4fc0_45d9_9bf8_289c0197792a.slice/crio-52eb4ea306584b1a9ea93d359d999bd8300a57875a19801d746bd59aa1608b54 WatchSource:0}: Error finding container 52eb4ea306584b1a9ea93d359d999bd8300a57875a19801d746bd59aa1608b54: Status 404 returned error can't find the container with id 52eb4ea306584b1a9ea93d359d999bd8300a57875a19801d746bd59aa1608b54 Jul 23 21:35:41.306337 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.306312 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:41.415161 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.415130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" event={"ID":"99eb8b5a-4fc0-45d9-9bf8-289c0197792a","Type":"ContainerStarted","Data":"52eb4ea306584b1a9ea93d359d999bd8300a57875a19801d746bd59aa1608b54"} Jul 23 21:35:41.460699 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:41.460662 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tp4v9"] Jul 23 21:35:41.465451 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:35:41.465417 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a24372c_3a6b_4360_a297_329398490dec.slice/crio-0aa7f8f98ed45149c18431b1fe61bfecf1201f6f461fb8460c491ca357a5e791 WatchSource:0}: Error finding container 0aa7f8f98ed45149c18431b1fe61bfecf1201f6f461fb8460c491ca357a5e791: Status 404 returned error can't find the container with id 0aa7f8f98ed45149c18431b1fe61bfecf1201f6f461fb8460c491ca357a5e791 Jul 23 21:35:42.106472 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.106430 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l56cr"] Jul 23 21:35:42.108997 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.108968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.115249 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.115174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 23 21:35:42.115390 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.115254 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mjtmx\"" Jul 23 21:35:42.129907 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.129878 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l56cr"] Jul 23 21:35:42.213328 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.213280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9wm\" (UniqueName: \"kubernetes.io/projected/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-kube-api-access-hs9wm\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.213512 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.213346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.314039 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.314003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9wm\" (UniqueName: \"kubernetes.io/projected/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-kube-api-access-hs9wm\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.314191 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.314064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.314237 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:35:42.314209 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 23 21:35:42.314290 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:35:42.314279 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs podName:b687d53f-bc5c-49fe-88f2-eecd3c441cd7 nodeName:}" failed. No retries permitted until 2026-07-23 21:35:42.814261108 +0000 UTC m=+595.954449221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs") pod "model-serving-api-54d89bd5fc-l56cr" (UID: "b687d53f-bc5c-49fe-88f2-eecd3c441cd7") : secret "model-serving-api-tls" not found Jul 23 21:35:42.323214 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.323192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9wm\" (UniqueName: \"kubernetes.io/projected/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-kube-api-access-hs9wm\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.347605 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.347566 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:42.350007 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.349990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.352798 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.352772 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 23 21:35:42.352941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.352774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 23 21:35:42.352941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.352778 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rl8lp\"" Jul 23 21:35:42.352941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.352779 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 21:35:42.352941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.352832 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 23 21:35:42.366932 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.366909 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:42.426428 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.426384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" event={"ID":"5a24372c-3a6b-4360-a297-329398490dec","Type":"ContainerStarted","Data":"0aa7f8f98ed45149c18431b1fe61bfecf1201f6f461fb8460c491ca357a5e791"} Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwp8j\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.515924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.515791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617103 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.616633 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwp8j\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.617563 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.617346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.619961 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.619912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.624040 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.623639 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.624040 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.623925 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.624040 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.623989 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.626659 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.626613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwp8j\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.627780 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.627737 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token\") pod \"istiod-openshift-gateway-7574459656-n8pbn\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.659761 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.659714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:42.819286 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.818779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.822479 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.822426 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b687d53f-bc5c-49fe-88f2-eecd3c441cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-l56cr\" (UID: \"b687d53f-bc5c-49fe-88f2-eecd3c441cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:42.856931 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:42.856657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:43.028943 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:43.028897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:43.224023 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:43.223985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l56cr"] Jul 23 21:35:43.228195 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:35:43.228161 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb687d53f_bc5c_49fe_88f2_eecd3c441cd7.slice/crio-8ed26f4b00640248d81364d109f0a4725e38fe92b63e58695a9ddf7e2d905928 WatchSource:0}: Error finding container 8ed26f4b00640248d81364d109f0a4725e38fe92b63e58695a9ddf7e2d905928: Status 404 returned error can't find the container with id 8ed26f4b00640248d81364d109f0a4725e38fe92b63e58695a9ddf7e2d905928 Jul 23 21:35:43.433989 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:43.433561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" event={"ID":"b687d53f-bc5c-49fe-88f2-eecd3c441cd7","Type":"ContainerStarted","Data":"8ed26f4b00640248d81364d109f0a4725e38fe92b63e58695a9ddf7e2d905928"} Jul 23 21:35:43.435303 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:43.435271 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" event={"ID":"2839acaf-3252-472d-9581-f435bf2aabf5","Type":"ContainerStarted","Data":"c933a589f582dde4f6b163a582f80d16947f415dced82ecec659c88c558e7eaa"} Jul 23 21:35:47.221786 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.221733 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 23 21:35:47.222154 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.221861 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 23 21:35:47.456039 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.455667 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" event={"ID":"99eb8b5a-4fc0-45d9-9bf8-289c0197792a","Type":"ContainerStarted","Data":"9210222f31417c399febef49a21ccb6b9f8bf2502a307a3643571b38e9ac6854"} Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.457510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" event={"ID":"5a24372c-3a6b-4360-a297-329398490dec","Type":"ContainerStarted","Data":"254ded5179ab1d12115a919e6be22b567444471472064cd9b82206b0fbaefa92"} Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.457602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.459458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" event={"ID":"b687d53f-bc5c-49fe-88f2-eecd3c441cd7","Type":"ContainerStarted","Data":"24cdd9c9e394d2920460ff50c2fe22abf8141626cf76eaf9557341bcd7883fa4"} Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.459585 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.461245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" event={"ID":"2839acaf-3252-472d-9581-f435bf2aabf5","Type":"ContainerStarted","Data":"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772"} Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.461411 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:47.474862 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.472590 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-2gbcb" podStartSLOduration=1.562963301 podStartE2EDuration="7.472571962s" totalImagesPullingTime="5.909608661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:47.471064882 +0000 UTC m=+600.611253019" watchObservedRunningTime="2026-07-23 21:35:47.472571962 +0000 UTC m=+600.612760101" Jul 23 21:35:47.491429 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.491373 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" podStartSLOduration=1.50020105 podStartE2EDuration="5.491357907s" totalImagesPullingTime="3.991156857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:47.490140681 +0000 UTC m=+600.630328817" watchObservedRunningTime="2026-07-23 21:35:47.491357907 +0000 UTC m=+600.631546043" Jul 23 21:35:47.510857 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.510805 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" podStartSLOduration=1.758808615 podStartE2EDuration="7.51078397s" totalImagesPullingTime="5.751975355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:47.509989573 +0000 UTC m=+600.650177722" watchObservedRunningTime="2026-07-23 21:35:47.51078397 +0000 UTC m=+600.650972109" Jul 23 21:35:47.529295 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:47.529242 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" podStartSLOduration=1.170482215 podStartE2EDuration="5.529221638s" totalImagesPullingTime="4.358739423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:47.527964635 +0000 UTC m=+600.668152781" watchObservedRunningTime="2026-07-23 21:35:47.529221638 +0000 UTC m=+600.669409774" Jul 23 21:35:48.466223 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:48.466196 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:50.827425 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.827378 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt"] Jul 23 21:35:50.830790 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.830766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.850586 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.850552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt"] Jul 23 21:35:50.885345 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885345 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jfp4\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-kube-api-access-8jfp4\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.885540 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.885537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.986797 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jfp4\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-kube-api-access-8jfp4\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.986797 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987035 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987035 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987035 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987035 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987035 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.986934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.987830 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.987800 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.989427 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.989399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.989516 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.989417 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.989558 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.989523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:50.989652 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:50.989636 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:51.004941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.004913 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jfp4\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-kube-api-access-8jfp4\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:51.006126 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.006104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8gkt\" (UID: \"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:51.139474 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.139380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:51.273676 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.273645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt"] Jul 23 21:35:51.275955 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:35:51.275930 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89fde7a_bf7e_467d_9c2e_95dcf43bc2a8.slice/crio-94b3e3ed0523a8dcc15d93df1074371727fb8bdcb3333a6ae9eadd8e84a6b0ab WatchSource:0}: Error finding container 94b3e3ed0523a8dcc15d93df1074371727fb8bdcb3333a6ae9eadd8e84a6b0ab: Status 404 returned error can't find the container with id 94b3e3ed0523a8dcc15d93df1074371727fb8bdcb3333a6ae9eadd8e84a6b0ab Jul 23 21:35:51.278100 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.278066 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 23 21:35:51.278187 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.278134 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 23 21:35:51.476945 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.476856 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" event={"ID":"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8","Type":"ContainerStarted","Data":"ff80d21931916941727eace885ab29d0c267dc442b8879d3ccd7ac9410b87b07"} Jul 23 21:35:51.476945 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.476914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" event={"ID":"e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8","Type":"ContainerStarted","Data":"94b3e3ed0523a8dcc15d93df1074371727fb8bdcb3333a6ae9eadd8e84a6b0ab"} Jul 23 21:35:51.477122 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.476968 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:51.501120 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:51.501072 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" podStartSLOduration=1.5010562570000001 podStartE2EDuration="1.501056257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:51.499768291 +0000 UTC m=+604.639956427" watchObservedRunningTime="2026-07-23 21:35:51.501056257 +0000 UTC m=+604.641244391" Jul 23 21:35:52.483882 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:52.483844 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-p8gkt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 21:35:52.484339 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:52.483899 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" podUID="e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:35:55.483596 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.483563 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8gkt" Jul 23 21:35:55.577276 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.577240 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:55.577471 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.577417 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" podUID="2839acaf-3252-472d-9581-f435bf2aabf5" containerName="discovery" containerID="cri-o://630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772" gracePeriod=30 Jul 23 21:35:55.825983 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.825955 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:55.926936 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.926903 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.926936 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.926939 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.926961 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.927014 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwp8j\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.927117 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.927151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927416 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.927220 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert\") pod \"2839acaf-3252-472d-9581-f435bf2aabf5\" (UID: \"2839acaf-3252-472d-9581-f435bf2aabf5\") " Jul 23 21:35:55.927528 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.927476 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:35:55.930001 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.929965 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts" (OuterVolumeSpecName: "cacerts") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:35:55.930114 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.929968 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j" (OuterVolumeSpecName: "kube-api-access-rwp8j") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "kube-api-access-rwp8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:35:55.930114 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.930001 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:35:55.930282 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.930259 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:35:55.930358 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.930303 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs" (OuterVolumeSpecName: "local-certs") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:35:55.930445 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:55.930428 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "2839acaf-3252-472d-9581-f435bf2aabf5" (UID: "2839acaf-3252-472d-9581-f435bf2aabf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028440 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwp8j\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-kube-api-access-rwp8j\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028473 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2839acaf-3252-472d-9581-f435bf2aabf5-istio-token\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028483 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-cacerts\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028495 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-dns-cert\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028504 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2839acaf-3252-472d-9581-f435bf2aabf5-istio-kubeconfig\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028512 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2839acaf-3252-472d-9581-f435bf2aabf5-local-certs\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.028529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.028521 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2839acaf-3252-472d-9581-f435bf2aabf5-istio-csr-ca-configmap\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:35:56.502016 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.501974 2578 generic.go:356] "Generic (PLEG): container finished" podID="2839acaf-3252-472d-9581-f435bf2aabf5" containerID="630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772" exitCode=0 Jul 23 21:35:56.502795 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.502593 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" Jul 23 21:35:56.502945 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.502618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" event={"ID":"2839acaf-3252-472d-9581-f435bf2aabf5","Type":"ContainerDied","Data":"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772"} Jul 23 21:35:56.502945 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.502906 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn" event={"ID":"2839acaf-3252-472d-9581-f435bf2aabf5","Type":"ContainerDied","Data":"c933a589f582dde4f6b163a582f80d16947f415dced82ecec659c88c558e7eaa"} Jul 23 21:35:56.503026 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.502950 2578 scope.go:117] "RemoveContainer" containerID="630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772" Jul 23 21:35:56.512232 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.512211 2578 scope.go:117] "RemoveContainer" containerID="630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772" Jul 23 21:35:56.512549 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:35:56.512521 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772\": container with ID starting with 630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772 not found: ID does not exist" containerID="630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772" Jul 23 21:35:56.512594 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.512558 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772"} err="failed to get container status \"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772\": rpc error: code = NotFound desc = could not find container \"630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772\": container with ID starting with 630170d9decf484de5173936f9a8157fd38bc5a11750ac8e1d99f31e18c6b772 not found: ID does not exist" Jul 23 21:35:56.536204 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.536173 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:56.550853 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:56.550818 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-n8pbn"] Jul 23 21:35:57.408158 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:57.408123 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2839acaf-3252-472d-9581-f435bf2aabf5" path="/var/lib/kubelet/pods/2839acaf-3252-472d-9581-f435bf2aabf5/volumes" Jul 23 21:35:58.466906 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:58.466873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tp4v9" Jul 23 21:35:58.468793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:35:58.468770 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l56cr" Jul 23 21:36:42.101106 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.101021 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:42.101548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.101311 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2839acaf-3252-472d-9581-f435bf2aabf5" containerName="discovery" Jul 23 21:36:42.101548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.101323 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2839acaf-3252-472d-9581-f435bf2aabf5" containerName="discovery" Jul 23 21:36:42.101548 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.101383 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2839acaf-3252-472d-9581-f435bf2aabf5" containerName="discovery" Jul 23 21:36:42.103181 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.103164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:42.107928 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.107899 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 21:36:42.108196 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.107913 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 21:36:42.108306 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.108006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bpzmv\"" Jul 23 21:36:42.124602 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.124569 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:42.191058 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.191020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkq6c\" (UniqueName: \"kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c\") pod \"kuadrant-operator-catalog-2gzs6\" (UID: \"a2c0038a-e753-4ac3-a69a-8446a22768a6\") " pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:42.292014 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.291977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkq6c\" (UniqueName: \"kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c\") pod \"kuadrant-operator-catalog-2gzs6\" (UID: \"a2c0038a-e753-4ac3-a69a-8446a22768a6\") " pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:42.305535 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.305498 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkq6c\" (UniqueName: \"kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c\") pod \"kuadrant-operator-catalog-2gzs6\" (UID: \"a2c0038a-e753-4ac3-a69a-8446a22768a6\") " pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:42.389630 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.389535 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:42.389870 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.389846 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:42.518655 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.518631 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:42.521329 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:36:42.521296 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c0038a_e753_4ac3_a69a_8446a22768a6.slice/crio-c9955e985b2c3278920b7592b5508006ff9e35114584a7032617e92cc662e84f WatchSource:0}: Error finding container c9955e985b2c3278920b7592b5508006ff9e35114584a7032617e92cc662e84f: Status 404 returned error can't find the container with id c9955e985b2c3278920b7592b5508006ff9e35114584a7032617e92cc662e84f Jul 23 21:36:42.594614 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.594576 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2dx"] Jul 23 21:36:42.597585 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.597568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:42.606841 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.606806 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2dx"] Jul 23 21:36:42.694344 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.694259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" event={"ID":"a2c0038a-e753-4ac3-a69a-8446a22768a6","Type":"ContainerStarted","Data":"c9955e985b2c3278920b7592b5508006ff9e35114584a7032617e92cc662e84f"} Jul 23 21:36:42.695517 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.695494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhwt\" (UniqueName: \"kubernetes.io/projected/2de82c88-8283-4d1f-940f-a4766ebfdaf0-kube-api-access-kdhwt\") pod \"kuadrant-operator-catalog-rv2dx\" (UID: \"2de82c88-8283-4d1f-940f-a4766ebfdaf0\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:42.796931 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.796899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhwt\" (UniqueName: \"kubernetes.io/projected/2de82c88-8283-4d1f-940f-a4766ebfdaf0-kube-api-access-kdhwt\") pod \"kuadrant-operator-catalog-rv2dx\" (UID: \"2de82c88-8283-4d1f-940f-a4766ebfdaf0\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:42.805358 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.805320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhwt\" (UniqueName: \"kubernetes.io/projected/2de82c88-8283-4d1f-940f-a4766ebfdaf0-kube-api-access-kdhwt\") pod \"kuadrant-operator-catalog-rv2dx\" (UID: \"2de82c88-8283-4d1f-940f-a4766ebfdaf0\") " pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:42.907623 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:42.907587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:43.034105 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:43.033957 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rv2dx"] Jul 23 21:36:43.036616 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:36:43.036591 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de82c88_8283_4d1f_940f_a4766ebfdaf0.slice/crio-ff31558753f05c49fa700ec103575791611cab602b13a6f34427a78f5531757b WatchSource:0}: Error finding container ff31558753f05c49fa700ec103575791611cab602b13a6f34427a78f5531757b: Status 404 returned error can't find the container with id ff31558753f05c49fa700ec103575791611cab602b13a6f34427a78f5531757b Jul 23 21:36:43.699707 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:43.699676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" event={"ID":"2de82c88-8283-4d1f-940f-a4766ebfdaf0","Type":"ContainerStarted","Data":"ff31558753f05c49fa700ec103575791611cab602b13a6f34427a78f5531757b"} Jul 23 21:36:45.709003 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.708960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" event={"ID":"a2c0038a-e753-4ac3-a69a-8446a22768a6","Type":"ContainerStarted","Data":"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5"} Jul 23 21:36:45.709003 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.708993 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" podUID="a2c0038a-e753-4ac3-a69a-8446a22768a6" containerName="registry-server" containerID="cri-o://8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5" gracePeriod=2 Jul 23 21:36:45.710487 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.710462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" event={"ID":"2de82c88-8283-4d1f-940f-a4766ebfdaf0","Type":"ContainerStarted","Data":"bf1509e7f4903835124d956741f41d71e701e33fe27091b4bb34b49fce6fd5b4"} Jul 23 21:36:45.726794 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.726735 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" podStartSLOduration=1.470437393 podStartE2EDuration="3.726719036s" totalImagesPullingTime="2.256281643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:36:45.72603789 +0000 UTC m=+658.866226027" watchObservedRunningTime="2026-07-23 21:36:45.726719036 +0000 UTC m=+658.866907173" Jul 23 21:36:45.741273 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.741232 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" podStartSLOduration=1.997519897 podStartE2EDuration="3.741217396s" totalImagesPullingTime="1.743697499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:36:45.740424744 +0000 UTC m=+658.880612874" watchObservedRunningTime="2026-07-23 21:36:45.741217396 +0000 UTC m=+658.881405555" Jul 23 21:36:45.951858 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:45.951832 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:46.123283 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.123239 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkq6c\" (UniqueName: \"kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c\") pod \"a2c0038a-e753-4ac3-a69a-8446a22768a6\" (UID: \"a2c0038a-e753-4ac3-a69a-8446a22768a6\") " Jul 23 21:36:46.125591 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.125556 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c" (OuterVolumeSpecName: "kube-api-access-dkq6c") pod "a2c0038a-e753-4ac3-a69a-8446a22768a6" (UID: "a2c0038a-e753-4ac3-a69a-8446a22768a6"). InnerVolumeSpecName "kube-api-access-dkq6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:36:46.224120 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.224084 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkq6c\" (UniqueName: \"kubernetes.io/projected/a2c0038a-e753-4ac3-a69a-8446a22768a6-kube-api-access-dkq6c\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:36:46.715432 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.715399 2578 generic.go:356] "Generic (PLEG): container finished" podID="a2c0038a-e753-4ac3-a69a-8446a22768a6" containerID="8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5" exitCode=0 Jul 23 21:36:46.715891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.715439 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" Jul 23 21:36:46.715891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.715490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" event={"ID":"a2c0038a-e753-4ac3-a69a-8446a22768a6","Type":"ContainerDied","Data":"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5"} Jul 23 21:36:46.715891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.715537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gzs6" event={"ID":"a2c0038a-e753-4ac3-a69a-8446a22768a6","Type":"ContainerDied","Data":"c9955e985b2c3278920b7592b5508006ff9e35114584a7032617e92cc662e84f"} Jul 23 21:36:46.715891 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.715559 2578 scope.go:117] "RemoveContainer" containerID="8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5" Jul 23 21:36:46.724566 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.724550 2578 scope.go:117] "RemoveContainer" containerID="8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5" Jul 23 21:36:46.724856 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:36:46.724837 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5\": container with ID starting with 8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5 not found: ID does not exist" containerID="8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5" Jul 23 21:36:46.724906 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.724863 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5"} err="failed to get container status \"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5\": rpc error: code = NotFound desc = could not find container \"8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5\": container with ID starting with 8e21401193b0b173ecaa333f7fb3b612aeef6ec47062a3689217d4dbf7281dd5 not found: ID does not exist" Jul 23 21:36:46.736009 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.735988 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:46.737766 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:46.737732 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gzs6"] Jul 23 21:36:47.407941 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:47.407904 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2c0038a-e753-4ac3-a69a-8446a22768a6" path="/var/lib/kubelet/pods/a2c0038a-e753-4ac3-a69a-8446a22768a6/volumes" Jul 23 21:36:52.908695 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:52.908645 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:52.909156 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:52.908738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:52.930923 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:52.930885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:36:53.768533 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:36:53.768506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rv2dx" Jul 23 21:37:14.976073 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.976036 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n"] Jul 23 21:37:14.976667 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.976423 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c0038a-e753-4ac3-a69a-8446a22768a6" containerName="registry-server" Jul 23 21:37:14.976667 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.976442 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c0038a-e753-4ac3-a69a-8446a22768a6" containerName="registry-server" Jul 23 21:37:14.976667 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.976537 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2c0038a-e753-4ac3-a69a-8446a22768a6" containerName="registry-server" Jul 23 21:37:14.979521 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.979499 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:14.982134 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.982111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rk5vf\"" Jul 23 21:37:14.991242 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:14.991217 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n"] Jul 23 21:37:15.035184 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.035131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbl8x\" (UniqueName: \"kubernetes.io/projected/b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74-kube-api-access-rbl8x\") pod \"authorino-operator-75cc8d5cb7-j6k5n\" (UID: \"b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:15.136424 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.136384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbl8x\" (UniqueName: \"kubernetes.io/projected/b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74-kube-api-access-rbl8x\") pod \"authorino-operator-75cc8d5cb7-j6k5n\" (UID: \"b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:15.145120 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.145087 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbl8x\" (UniqueName: \"kubernetes.io/projected/b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74-kube-api-access-rbl8x\") pod \"authorino-operator-75cc8d5cb7-j6k5n\" (UID: \"b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:15.289500 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.289458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:15.421652 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.421622 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n"] Jul 23 21:37:15.425724 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:37:15.425691 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ac3c24_1ee9_4a9c_9b2c_6cc2f178ca74.slice/crio-a1f40f478041d901fa399ffa8ed4f5e00b6dbbc6322b97aada99509e9793235f WatchSource:0}: Error finding container a1f40f478041d901fa399ffa8ed4f5e00b6dbbc6322b97aada99509e9793235f: Status 404 returned error can't find the container with id a1f40f478041d901fa399ffa8ed4f5e00b6dbbc6322b97aada99509e9793235f Jul 23 21:37:15.427677 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.427657 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:37:15.828843 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:15.828806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" event={"ID":"b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74","Type":"ContainerStarted","Data":"a1f40f478041d901fa399ffa8ed4f5e00b6dbbc6322b97aada99509e9793235f"} Jul 23 21:37:18.201788 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.201682 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474"] Jul 23 21:37:18.204966 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.204949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:18.207456 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.207428 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 23 21:37:18.207924 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.207893 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lv4qz\"" Jul 23 21:37:18.215257 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.215236 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474"] Jul 23 21:37:18.261543 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.261507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sxkb\" (UniqueName: \"kubernetes.io/projected/407519fc-79e2-4f56-b8eb-9897160873ad-kube-api-access-2sxkb\") pod \"dns-operator-controller-manager-864dd78c4c-fk474\" (UID: \"407519fc-79e2-4f56-b8eb-9897160873ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:18.362095 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.362060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sxkb\" (UniqueName: \"kubernetes.io/projected/407519fc-79e2-4f56-b8eb-9897160873ad-kube-api-access-2sxkb\") pod \"dns-operator-controller-manager-864dd78c4c-fk474\" (UID: \"407519fc-79e2-4f56-b8eb-9897160873ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:18.383664 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.383630 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sxkb\" (UniqueName: \"kubernetes.io/projected/407519fc-79e2-4f56-b8eb-9897160873ad-kube-api-access-2sxkb\") pod \"dns-operator-controller-manager-864dd78c4c-fk474\" (UID: \"407519fc-79e2-4f56-b8eb-9897160873ad\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:18.515227 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.515190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:18.645507 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.645474 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474"] Jul 23 21:37:18.648547 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:37:18.648519 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod407519fc_79e2_4f56_b8eb_9897160873ad.slice/crio-ef7f16a75447958599d4ec6c343d42ea985c72a2dfd4a4840a3328e3b19e69e6 WatchSource:0}: Error finding container ef7f16a75447958599d4ec6c343d42ea985c72a2dfd4a4840a3328e3b19e69e6: Status 404 returned error can't find the container with id ef7f16a75447958599d4ec6c343d42ea985c72a2dfd4a4840a3328e3b19e69e6 Jul 23 21:37:18.843866 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.843734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" event={"ID":"407519fc-79e2-4f56-b8eb-9897160873ad","Type":"ContainerStarted","Data":"ef7f16a75447958599d4ec6c343d42ea985c72a2dfd4a4840a3328e3b19e69e6"} Jul 23 21:37:18.845159 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.845136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" event={"ID":"b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74","Type":"ContainerStarted","Data":"8b3cf1f579f475ede7d97447abd9d9f4f6213baa02f30a355218e776f96ec27b"} Jul 23 21:37:18.845278 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.845267 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:18.868323 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:18.868275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" podStartSLOduration=2.43040676 podStartE2EDuration="4.868260303s" totalImagesPullingTime="2.437853543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:18.86643842 +0000 UTC m=+692.006626563" watchObservedRunningTime="2026-07-23 21:37:18.868260303 +0000 UTC m=+692.008448510" Jul 23 21:37:20.856402 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:20.856367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" event={"ID":"407519fc-79e2-4f56-b8eb-9897160873ad","Type":"ContainerStarted","Data":"8f67daf2c38f179f6faac9dabdc10d51e3f234d38e245d20ad8da6df70c23150"} Jul 23 21:37:20.856817 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:20.856489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:20.872962 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:20.872904 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" podStartSLOduration=0.753170386 podStartE2EDuration="2.872887687s" totalImagesPullingTime="2.119717301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:20.870965424 +0000 UTC m=+694.011153577" watchObservedRunningTime="2026-07-23 21:37:20.872887687 +0000 UTC m=+694.013075823" Jul 23 21:37:26.357696 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.357652 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9"] Jul 23 21:37:26.361093 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.361069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.363964 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.363939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbq99\"" Jul 23 21:37:26.375332 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.375309 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9"] Jul 23 21:37:26.430920 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.430890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.431083 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.430947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6tdr\" (UniqueName: \"kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.531713 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.531671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.531925 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.531796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6tdr\" (UniqueName: \"kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.532121 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.532098 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.543793 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.543763 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6tdr\" (UniqueName: \"kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.670876 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.670780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:26.802221 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.802139 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9"] Jul 23 21:37:26.807766 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:37:26.807703 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb3d62c_6196_4b27_ad65_746a1b54c7ed.slice/crio-477bdf58de3fa14803ab11da0d1fc86ae5ec1b33aaa1fe7b306f8163c2722f0a WatchSource:0}: Error finding container 477bdf58de3fa14803ab11da0d1fc86ae5ec1b33aaa1fe7b306f8163c2722f0a: Status 404 returned error can't find the container with id 477bdf58de3fa14803ab11da0d1fc86ae5ec1b33aaa1fe7b306f8163c2722f0a Jul 23 21:37:26.881101 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:26.881066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" event={"ID":"beb3d62c-6196-4b27-ad65-746a1b54c7ed","Type":"ContainerStarted","Data":"477bdf58de3fa14803ab11da0d1fc86ae5ec1b33aaa1fe7b306f8163c2722f0a"} Jul 23 21:37:29.852472 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:29.852439 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-j6k5n" Jul 23 21:37:31.862948 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:31.862909 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fk474" Jul 23 21:37:32.917638 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:32.917602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" event={"ID":"beb3d62c-6196-4b27-ad65-746a1b54c7ed","Type":"ContainerStarted","Data":"6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3"} Jul 23 21:37:32.918060 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:32.917768 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:32.938237 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:32.938180 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" podStartSLOduration=1.763700123 podStartE2EDuration="6.93816335s" totalImagesPullingTime="5.174463227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:32.937956054 +0000 UTC m=+706.078144190" watchObservedRunningTime="2026-07-23 21:37:32.93816335 +0000 UTC m=+706.078351485" Jul 23 21:37:43.924624 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:43.924536 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:45.738014 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.737971 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9"] Jul 23 21:37:45.738605 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.738209 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" containerName="manager" containerID="cri-o://6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3" gracePeriod=2 Jul 23 21:37:45.739982 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.739957 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9"] Jul 23 21:37:45.740599 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:45.740563 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:45.781114 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.781076 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:37:45.781365 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.781352 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" containerName="manager" Jul 23 21:37:45.781365 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.781365 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" containerName="manager" Jul 23 21:37:45.781492 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.781423 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" containerName="manager" Jul 23 21:37:45.784212 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.784188 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:45.810151 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.810121 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:37:45.835272 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:45.835225 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:45.904889 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.904848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:45.905043 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.904901 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dg2p\" (UniqueName: \"kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:45.979996 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.979968 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:45.980734 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.980711 2578 generic.go:356] "Generic (PLEG): container finished" podID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" containerID="6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3" exitCode=0 Jul 23 21:37:45.980864 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.980791 2578 scope.go:117] "RemoveContainer" containerID="6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3" Jul 23 21:37:45.982210 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:45.982177 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:45.988679 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.988652 2578 scope.go:117] "RemoveContainer" containerID="6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3" Jul 23 21:37:45.988968 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:45.988950 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3\": container with ID starting with 6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3 not found: ID does not exist" containerID="6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3" Jul 23 21:37:45.989015 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:45.988979 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3"} err="failed to get container status \"6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3\": rpc error: code = NotFound desc = could not find container \"6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3\": container with ID starting with 6ba105bc116f02ec428848b4b3daa2990dc496c256db30376b523bed5d8c00a3 not found: ID does not exist" Jul 23 21:37:46.006364 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.006328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.006364 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.006366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dg2p\" (UniqueName: \"kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.006725 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.006707 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.016150 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.016118 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dg2p\" (UniqueName: \"kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vdnnm\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.107709 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.107675 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume\") pod \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " Jul 23 21:37:46.107902 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.107732 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6tdr\" (UniqueName: \"kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr\") pod \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\" (UID: \"beb3d62c-6196-4b27-ad65-746a1b54c7ed\") " Jul 23 21:37:46.108239 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.108207 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "beb3d62c-6196-4b27-ad65-746a1b54c7ed" (UID: "beb3d62c-6196-4b27-ad65-746a1b54c7ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:37:46.109786 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.109762 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr" (OuterVolumeSpecName: "kube-api-access-c6tdr") pod "beb3d62c-6196-4b27-ad65-746a1b54c7ed" (UID: "beb3d62c-6196-4b27-ad65-746a1b54c7ed"). InnerVolumeSpecName "kube-api-access-c6tdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:37:46.110882 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.110861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.208614 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.208568 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb3d62c-6196-4b27-ad65-746a1b54c7ed-extensions-socket-volume\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:37:46.208614 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.208606 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6tdr\" (UniqueName: \"kubernetes.io/projected/beb3d62c-6196-4b27-ad65-746a1b54c7ed-kube-api-access-c6tdr\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:37:46.256010 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.255917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:37:46.259978 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:37:46.259950 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bfd3c78_18d9_493a_b44c_784557e2bee2.slice/crio-1b1d3b12edcc5f428e427245a890bd804a6c2c8df8a965e8b3de0d9e92bf1dc1 WatchSource:0}: Error finding container 1b1d3b12edcc5f428e427245a890bd804a6c2c8df8a965e8b3de0d9e92bf1dc1: Status 404 returned error can't find the container with id 1b1d3b12edcc5f428e427245a890bd804a6c2c8df8a965e8b3de0d9e92bf1dc1 Jul 23 21:37:46.986907 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.986866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" event={"ID":"6bfd3c78-18d9-493a-b44c-784557e2bee2","Type":"ContainerStarted","Data":"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4"} Jul 23 21:37:46.987353 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.987034 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:37:46.987353 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.987082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" event={"ID":"6bfd3c78-18d9-493a-b44c-784557e2bee2","Type":"ContainerStarted","Data":"1b1d3b12edcc5f428e427245a890bd804a6c2c8df8a965e8b3de0d9e92bf1dc1"} Jul 23 21:37:46.987913 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:46.987893 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:47.009290 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:47.009249 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" podStartSLOduration=2.009235068 podStartE2EDuration="2.009235068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:47.007412599 +0000 UTC m=+720.147600735" watchObservedRunningTime="2026-07-23 21:37:47.009235068 +0000 UTC m=+720.149423204" Jul 23 21:37:47.009774 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:47.009726 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:47.011697 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:47.011677 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:47.406342 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:37:47.406293 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bsql9\" is forbidden: User \"system:node:ip-10-0-130-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-109.ec2.internal' and this object" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsql9" Jul 23 21:37:47.407922 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:47.407896 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb3d62c-6196-4b27-ad65-746a1b54c7ed" path="/var/lib/kubelet/pods/beb3d62c-6196-4b27-ad65-746a1b54c7ed/volumes" Jul 23 21:37:57.994758 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:37:57.994722 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:38:15.009954 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.009915 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:38:15.010389 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.010129 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" podUID="6bfd3c78-18d9-493a-b44c-784557e2bee2" containerName="manager" containerID="cri-o://cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4" gracePeriod=10 Jul 23 21:38:15.258232 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.258203 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:38:15.288701 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.288619 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp"] Jul 23 21:38:15.289104 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.289060 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bfd3c78-18d9-493a-b44c-784557e2bee2" containerName="manager" Jul 23 21:38:15.289104 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.289105 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bfd3c78-18d9-493a-b44c-784557e2bee2" containerName="manager" Jul 23 21:38:15.289231 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.289175 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bfd3c78-18d9-493a-b44c-784557e2bee2" containerName="manager" Jul 23 21:38:15.291025 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.291004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.310697 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.310671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dg2p\" (UniqueName: \"kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p\") pod \"6bfd3c78-18d9-493a-b44c-784557e2bee2\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " Jul 23 21:38:15.310846 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.310774 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume\") pod \"6bfd3c78-18d9-493a-b44c-784557e2bee2\" (UID: \"6bfd3c78-18d9-493a-b44c-784557e2bee2\") " Jul 23 21:38:15.310928 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.310910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0dbe8ac-ebcf-4139-8360-8f19041459a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.310980 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.310934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjpm\" (UniqueName: \"kubernetes.io/projected/f0dbe8ac-ebcf-4139-8360-8f19041459a8-kube-api-access-txjpm\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.311149 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.311121 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6bfd3c78-18d9-493a-b44c-784557e2bee2" (UID: "6bfd3c78-18d9-493a-b44c-784557e2bee2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:38:15.311356 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.311337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp"] Jul 23 21:38:15.313072 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.313047 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p" (OuterVolumeSpecName: "kube-api-access-4dg2p") pod "6bfd3c78-18d9-493a-b44c-784557e2bee2" (UID: "6bfd3c78-18d9-493a-b44c-784557e2bee2"). InnerVolumeSpecName "kube-api-access-4dg2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:38:15.411495 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.411460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0dbe8ac-ebcf-4139-8360-8f19041459a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.411495 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.411494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjpm\" (UniqueName: \"kubernetes.io/projected/f0dbe8ac-ebcf-4139-8360-8f19041459a8-kube-api-access-txjpm\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.411682 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.411564 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dg2p\" (UniqueName: \"kubernetes.io/projected/6bfd3c78-18d9-493a-b44c-784557e2bee2-kube-api-access-4dg2p\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:38:15.411682 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.411579 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bfd3c78-18d9-493a-b44c-784557e2bee2-extensions-socket-volume\") on node \"ip-10-0-130-109.ec2.internal\" DevicePath \"\"" Jul 23 21:38:15.411961 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.411935 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f0dbe8ac-ebcf-4139-8360-8f19041459a8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.419512 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.419489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjpm\" (UniqueName: \"kubernetes.io/projected/f0dbe8ac-ebcf-4139-8360-8f19041459a8-kube-api-access-txjpm\") pod \"kuadrant-operator-controller-manager-86878c769f-gq7bp\" (UID: \"f0dbe8ac-ebcf-4139-8360-8f19041459a8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.601395 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.601313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:15.733107 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:15.733088 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp"] Jul 23 21:38:15.735224 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:38:15.735197 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0dbe8ac_ebcf_4139_8360_8f19041459a8.slice/crio-a945b9b59b3e5a9e71925da34c91ff1a158122105c42717ca91dc9928cc50e30 WatchSource:0}: Error finding container a945b9b59b3e5a9e71925da34c91ff1a158122105c42717ca91dc9928cc50e30: Status 404 returned error can't find the container with id a945b9b59b3e5a9e71925da34c91ff1a158122105c42717ca91dc9928cc50e30 Jul 23 21:38:16.109791 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.109757 2578 generic.go:356] "Generic (PLEG): container finished" podID="6bfd3c78-18d9-493a-b44c-784557e2bee2" containerID="cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4" exitCode=0 Jul 23 21:38:16.110244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.109800 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" Jul 23 21:38:16.110244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.109848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" event={"ID":"6bfd3c78-18d9-493a-b44c-784557e2bee2","Type":"ContainerDied","Data":"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4"} Jul 23 21:38:16.110244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.109902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm" event={"ID":"6bfd3c78-18d9-493a-b44c-784557e2bee2","Type":"ContainerDied","Data":"1b1d3b12edcc5f428e427245a890bd804a6c2c8df8a965e8b3de0d9e92bf1dc1"} Jul 23 21:38:16.110244 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.109929 2578 scope.go:117] "RemoveContainer" containerID="cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4" Jul 23 21:38:16.111665 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.111640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" event={"ID":"f0dbe8ac-ebcf-4139-8360-8f19041459a8","Type":"ContainerStarted","Data":"9fb2848f6a0ae34de4dea13ff61f0297327d9ffd301cbd1dd084b8db138aa11f"} Jul 23 21:38:16.111801 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.111691 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" event={"ID":"f0dbe8ac-ebcf-4139-8360-8f19041459a8","Type":"ContainerStarted","Data":"a945b9b59b3e5a9e71925da34c91ff1a158122105c42717ca91dc9928cc50e30"} Jul 23 21:38:16.111801 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.111736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:16.118136 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.118103 2578 scope.go:117] "RemoveContainer" containerID="cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4" Jul 23 21:38:16.118401 ip-10-0-130-109 kubenswrapper[2578]: E0723 21:38:16.118383 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4\": container with ID starting with cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4 not found: ID does not exist" containerID="cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4" Jul 23 21:38:16.118469 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.118412 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4"} err="failed to get container status \"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4\": rpc error: code = NotFound desc = could not find container \"cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4\": container with ID starting with cce20941eeb5a3848583993bc2e623697813b3acbfc4befeac198d56b2e335e4 not found: ID does not exist" Jul 23 21:38:16.129519 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.129496 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:38:16.136450 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.136427 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vdnnm"] Jul 23 21:38:16.158814 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:16.158763 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" podStartSLOduration=1.158736101 podStartE2EDuration="1.158736101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:16.157346934 +0000 UTC m=+749.297535070" watchObservedRunningTime="2026-07-23 21:38:16.158736101 +0000 UTC m=+749.298924238" Jul 23 21:38:17.408163 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:17.408128 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bfd3c78-18d9-493a-b44c-784557e2bee2" path="/var/lib/kubelet/pods/6bfd3c78-18d9-493a-b44c-784557e2bee2/volumes" Jul 23 21:38:27.124250 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:27.124212 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-gq7bp" Jul 23 21:38:36.512438 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.512406 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7z4z"] Jul 23 21:38:36.515456 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.515436 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.518039 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.518017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-846n7\"" Jul 23 21:38:36.518123 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.518017 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 21:38:36.523220 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.523196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7z4z"] Jul 23 21:38:36.553454 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.553426 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7z4z"] Jul 23 21:38:36.565392 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.565362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd368e56-d87b-45bd-99ee-49e5e262129c-config-file\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.565529 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.565457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc29b\" (UniqueName: \"kubernetes.io/projected/fd368e56-d87b-45bd-99ee-49e5e262129c-kube-api-access-hc29b\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.666252 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.666213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc29b\" (UniqueName: \"kubernetes.io/projected/fd368e56-d87b-45bd-99ee-49e5e262129c-kube-api-access-hc29b\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.666411 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.666281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd368e56-d87b-45bd-99ee-49e5e262129c-config-file\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.666991 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.666964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd368e56-d87b-45bd-99ee-49e5e262129c-config-file\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.674639 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.674607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc29b\" (UniqueName: \"kubernetes.io/projected/fd368e56-d87b-45bd-99ee-49e5e262129c-kube-api-access-hc29b\") pod \"limitador-limitador-54d6d988d5-s7z4z\" (UID: \"fd368e56-d87b-45bd-99ee-49e5e262129c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.826023 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.825936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:36.954813 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:36.954782 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-s7z4z"] Jul 23 21:38:36.957398 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:38:36.957366 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd368e56_d87b_45bd_99ee_49e5e262129c.slice/crio-4cf6e96f0c37e1f2d208bb1aba93fb44822bc5f2bd9befd0e248e4556858f0a8 WatchSource:0}: Error finding container 4cf6e96f0c37e1f2d208bb1aba93fb44822bc5f2bd9befd0e248e4556858f0a8: Status 404 returned error can't find the container with id 4cf6e96f0c37e1f2d208bb1aba93fb44822bc5f2bd9befd0e248e4556858f0a8 Jul 23 21:38:37.209778 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:37.209686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" event={"ID":"fd368e56-d87b-45bd-99ee-49e5e262129c","Type":"ContainerStarted","Data":"4cf6e96f0c37e1f2d208bb1aba93fb44822bc5f2bd9befd0e248e4556858f0a8"} Jul 23 21:38:40.225082 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:40.225041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" event={"ID":"fd368e56-d87b-45bd-99ee-49e5e262129c","Type":"ContainerStarted","Data":"e0c18276c4a9358eeec0636983ab6aac0a67c4792be30af4faffc35ea911f890"} Jul 23 21:38:40.225559 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:40.225174 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:38:40.242338 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:40.242290 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" podStartSLOduration=1.733348042 podStartE2EDuration="4.24227537s" totalImagesPullingTime="2.508927328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:40.241457134 +0000 UTC m=+773.381645292" watchObservedRunningTime="2026-07-23 21:38:40.24227537 +0000 UTC m=+773.382463505" Jul 23 21:38:51.231092 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:38:51.231060 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-s7z4z" Jul 23 21:49:45.910899 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:45.910816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l56cr_b687d53f-bc5c-49fe-88f2-eecd3c441cd7/server/0.log" Jul 23 21:49:46.031356 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:46.031328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tp4v9_5a24372c-3a6b-4360-a297-329398490dec/manager/0.log" Jul 23 21:49:46.396942 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:46.396918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-l57rp_717b6b90-c2f8-402a-a353-fa868d28545d/copy-manifests/0.log" Jul 23 21:49:46.411150 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:46.411126 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-l57rp_717b6b90-c2f8-402a-a353-fa868d28545d/manager/0.log" Jul 23 21:49:48.050368 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:48.050338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j6k5n_b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74/manager/0.log" Jul 23 21:49:48.166422 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:48.166391 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fk474_407519fc-79e2-4f56-b8eb-9897160873ad/manager/0.log" Jul 23 21:49:48.399846 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:48.399775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rv2dx_2de82c88-8283-4d1f-940f-a4766ebfdaf0/registry-server/0.log" Jul 23 21:49:48.514620 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:48.514593 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gq7bp_f0dbe8ac-ebcf-4139-8360-8f19041459a8/manager/0.log" Jul 23 21:49:48.623351 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:48.623326 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s7z4z_fd368e56-d87b-45bd-99ee-49e5e262129c/limitador/0.log" Jul 23 21:49:49.216157 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:49.216127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8gkt_e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8/discovery/0.log" Jul 23 21:49:49.336313 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:49.336283 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-2gbcb_99eb8b5a-4fc0-45d9-9bf8-289c0197792a/kube-auth-proxy/0.log" Jul 23 21:49:58.971968 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:58.971935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tfk45_ca3e117c-8409-4303-ab25-34e2e40350f6/global-pull-secret-syncer/0.log" Jul 23 21:49:59.051005 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:59.050974 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kpwv5_a9a931a5-9c6d-4ad5-bc01-f32248486449/konnectivity-agent/0.log" Jul 23 21:49:59.098415 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:49:59.098387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-109.ec2.internal_c8af94d40da9ac8160345a87ba6c1a1f/haproxy/0.log" Jul 23 21:50:04.633555 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:04.633525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-j6k5n_b7ac3c24-1ee9-4a9c-9b2c-6cc2f178ca74/manager/0.log" Jul 23 21:50:04.658427 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:04.658405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fk474_407519fc-79e2-4f56-b8eb-9897160873ad/manager/0.log" Jul 23 21:50:04.735525 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:04.735495 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rv2dx_2de82c88-8283-4d1f-940f-a4766ebfdaf0/registry-server/0.log" Jul 23 21:50:04.770389 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:04.770364 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-gq7bp_f0dbe8ac-ebcf-4139-8360-8f19041459a8/manager/0.log" Jul 23 21:50:04.795618 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:04.795588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-s7z4z_fd368e56-d87b-45bd-99ee-49e5e262129c/limitador/0.log" Jul 23 21:50:06.908080 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:06.908051 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwncj_0100c587-2589-4d19-be2f-a0a433ce3585/node-exporter/0.log" Jul 23 21:50:06.929056 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:06.929035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwncj_0100c587-2589-4d19-be2f-a0a433ce3585/kube-rbac-proxy/0.log" Jul 23 21:50:06.953693 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:06.953674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwncj_0100c587-2589-4d19-be2f-a0a433ce3585/init-textfile/0.log" Jul 23 21:50:08.227930 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.227894 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9"] Jul 23 21:50:08.231174 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.231153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.233704 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.233684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m4gt\"/\"default-dockercfg-t8fz8\"" Jul 23 21:50:08.233831 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.233708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"openshift-service-ca.crt\"" Jul 23 21:50:08.234650 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.234636 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"kube-root-ca.crt\"" Jul 23 21:50:08.241286 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.241266 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9"] Jul 23 21:50:08.317224 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.317200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-sys\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.317334 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.317245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-proc\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.317394 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.317344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjj75\" (UniqueName: \"kubernetes.io/projected/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-kube-api-access-vjj75\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.317394 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.317377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-podres\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.317476 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.317405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-lib-modules\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418458 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjj75\" (UniqueName: \"kubernetes.io/projected/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-kube-api-access-vjj75\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418559 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-podres\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418559 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-lib-modules\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418637 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-podres\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418637 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-sys\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418709 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-proc\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418709 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418677 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-sys\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418709 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418652 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-lib-modules\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.418837 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.418736 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-proc\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.428773 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.428755 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjj75\" (UniqueName: \"kubernetes.io/projected/3c60ae20-e6d7-431f-a70a-0f3f3bd141d6-kube-api-access-vjj75\") pod \"perf-node-gather-daemonset-djcs9\" (UID: \"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.541232 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.541210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:08.640727 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.640703 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-gxflc_90b4b78d-d7ef-4c6d-83dd-e300cdd89b90/networking-console-plugin/0.log" Jul 23 21:50:08.667020 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:08.666950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9"] Jul 23 21:50:08.669257 ip-10-0-130-109 kubenswrapper[2578]: W0723 21:50:08.669231 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c60ae20_e6d7_431f_a70a_0f3f3bd141d6.slice/crio-9933a45fec315518a6c8e304b628c33a9cd4890a27c2a4ec90adc017131ad170 WatchSource:0}: Error finding container 9933a45fec315518a6c8e304b628c33a9cd4890a27c2a4ec90adc017131ad170: Status 404 returned error can't find the container with id 9933a45fec315518a6c8e304b628c33a9cd4890a27c2a4ec90adc017131ad170 Jul 23 21:50:09.047478 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:09.047448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" event={"ID":"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6","Type":"ContainerStarted","Data":"6aeb57c45042312c217cbd40b9247cd8fc93047f1d6ac8592372020b54dc9393"} Jul 23 21:50:09.047700 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:09.047607 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:09.047700 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:09.047642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" event={"ID":"3c60ae20-e6d7-431f-a70a-0f3f3bd141d6","Type":"ContainerStarted","Data":"9933a45fec315518a6c8e304b628c33a9cd4890a27c2a4ec90adc017131ad170"} Jul 23 21:50:09.065092 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:09.065041 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" podStartSLOduration=1.06502447 podStartE2EDuration="1.06502447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:50:09.064305126 +0000 UTC m=+1462.204493264" watchObservedRunningTime="2026-07-23 21:50:09.06502447 +0000 UTC m=+1462.205212605" Jul 23 21:50:11.393887 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:11.393858 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxr59_68aefd2f-950d-4dbd-8761-0d77116dac38/dns/0.log" Jul 23 21:50:11.414434 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:11.414410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cxr59_68aefd2f-950d-4dbd-8761-0d77116dac38/kube-rbac-proxy/0.log" Jul 23 21:50:11.488545 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:11.488522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tcpqb_3544c995-cd90-4090-b348-6199ea1e7c1a/dns-node-resolver/0.log" Jul 23 21:50:12.112061 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:12.112031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxndw_3e4a2940-4a7f-4876-9037-b065fdec7803/node-ca/0.log" Jul 23 21:50:13.097863 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:13.097833 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8gkt_e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8/discovery/0.log" Jul 23 21:50:13.121498 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:13.121473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-2gbcb_99eb8b5a-4fc0-45d9-9bf8-289c0197792a/kube-auth-proxy/0.log" Jul 23 21:50:13.804959 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:13.804933 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jg45h_56720bc5-45d5-48fd-956e-b8c2336efcdb/serve-healthcheck-canary/0.log" Jul 23 21:50:14.377601 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:14.377577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjbg2_7a9c1f99-774e-433c-86ef-33a2476a0a0b/kube-rbac-proxy/0.log" Jul 23 21:50:14.398866 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:14.398839 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjbg2_7a9c1f99-774e-433c-86ef-33a2476a0a0b/exporter/0.log" Jul 23 21:50:14.418392 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:14.418354 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjbg2_7a9c1f99-774e-433c-86ef-33a2476a0a0b/extractor/0.log" Jul 23 21:50:15.061146 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:15.061117 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-djcs9" Jul 23 21:50:16.714029 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:16.713996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l56cr_b687d53f-bc5c-49fe-88f2-eecd3c441cd7/server/0.log" Jul 23 21:50:16.762187 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:16.762159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tp4v9_5a24372c-3a6b-4360-a297-329398490dec/manager/0.log" Jul 23 21:50:16.913543 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:16.913516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-l57rp_717b6b90-c2f8-402a-a353-fa868d28545d/manager/0.log" Jul 23 21:50:16.930041 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:16.930019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-l57rp_717b6b90-c2f8-402a-a353-fa868d28545d/copy-manifests/0.log" Jul 23 21:50:19.220800 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:19.220776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8gkt_e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8/discovery/0.log" Jul 23 21:50:19.230616 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:19.230593 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-2gbcb_99eb8b5a-4fc0-45d9-9bf8-289c0197792a/kube-auth-proxy/0.log" Jul 23 21:50:20.323271 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:20.323235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8gkt_e89fde7a-bf7e-467d-9c2e-95dcf43bc2a8/discovery/0.log" Jul 23 21:50:20.335288 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:20.335263 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-2gbcb_99eb8b5a-4fc0-45d9-9bf8-289c0197792a/kube-auth-proxy/0.log" Jul 23 21:50:24.627926 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.627886 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2rvww_2ceace3b-3157-4d67-9f52-a05962f3fa4e/kube-multus/0.log" Jul 23 21:50:24.803213 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.803187 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/kube-multus-additional-cni-plugins/0.log" Jul 23 21:50:24.823717 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.823695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/egress-router-binary-copy/0.log" Jul 23 21:50:24.843384 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.843365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/cni-plugins/0.log" Jul 23 21:50:24.864022 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.864005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/bond-cni-plugin/0.log" Jul 23 21:50:24.884105 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.884059 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/routeoverride-cni/0.log" Jul 23 21:50:24.905437 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.905420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/whereabouts-cni-bincopy/0.log" Jul 23 21:50:24.924532 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:24.924512 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f8nbc_971ceb35-e0cc-4f35-81e6-d3f941c2421b/whereabouts-cni/0.log" Jul 23 21:50:25.213399 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:25.213333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmbts_6af2c0e1-2bc9-430b-b8fe-414a6af6fe18/network-metrics-daemon/0.log" Jul 23 21:50:25.234565 ip-10-0-130-109 kubenswrapper[2578]: I0723 21:50:25.234545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jmbts_6af2c0e1-2bc9-430b-b8fe-414a6af6fe18/kube-rbac-proxy/0.log"