Jul 27 16:24:14.862516 ip-10-0-128-172 systemd[1]: Starting Kubernetes Kubelet... Jul 27 16:24:15.209925 ip-10-0-128-172 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:15.209925 ip-10-0-128-172 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 16:24:15.209925 ip-10-0-128-172 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:15.209925 ip-10-0-128-172 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 16:24:15.209925 ip-10-0-128-172 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 16:24:15.211619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.211492 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 16:24:15.216487 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216472 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.216487 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216487 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216491 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216496 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216499 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216502 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216506 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216509 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216512 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216515 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216518 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216521 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216524 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216526 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216529 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216532 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216534 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216537 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216540 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216543 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.216549 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216546 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216548 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216551 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216554 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216556 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216559 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216562 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216565 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216568 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216571 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216573 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216576 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216578 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216581 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216584 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216586 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216589 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216591 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216594 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216596 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.216995 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216599 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216602 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216604 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216607 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216610 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216614 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216616 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216619 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216621 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216624 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216626 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216629 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216631 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216634 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216638 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216641 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216643 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216646 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216650 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216655 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.217488 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216657 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216660 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216663 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216665 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216668 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216670 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216673 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216675 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216678 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216681 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216683 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216687 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216690 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216692 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216695 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216698 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216701 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216703 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216706 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216709 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.217975 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216711 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216715 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216717 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216720 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216723 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216726 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216728 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216733 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216737 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216740 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216743 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216746 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216749 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216751 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216754 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216757 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216759 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216762 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.216765 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.218462 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217472 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217478 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217481 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217486 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217491 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217499 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217503 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217506 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217509 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217511 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217514 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217517 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217519 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217522 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217525 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217527 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217530 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217532 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217535 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.218906 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217538 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217541 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217544 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217547 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217549 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217552 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217554 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217557 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217561 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217564 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217567 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217570 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217572 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217575 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217578 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217581 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217584 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217587 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217590 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217599 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.219397 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217602 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217604 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217607 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217610 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217614 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217616 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217619 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217621 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217624 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217627 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217629 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217632 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217634 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217637 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217639 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217642 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217644 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217647 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217650 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217653 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.219887 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217657 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217660 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217663 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217666 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217676 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217679 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217681 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217684 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217687 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217690 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217692 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217695 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217705 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217708 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217710 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217713 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217716 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217719 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217722 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217725 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.220384 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217728 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217731 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217734 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217736 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217739 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217742 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217745 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217747 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217749 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217752 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217755 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217757 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217760 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217762 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217765 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217768 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217770 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217772 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217775 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.220883 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.217777 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218198 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218204 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218208 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218210 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218214 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218232 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218238 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218245 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218250 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218253 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218256 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218259 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218262 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218264 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218267 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218269 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218272 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218275 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.221372 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218277 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218280 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218282 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218285 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218287 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218290 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218293 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218295 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218298 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218300 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218303 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218305 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218307 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218310 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218315 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218317 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218320 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218323 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218325 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218328 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.221840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218331 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218335 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218338 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218341 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218343 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218346 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218348 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218351 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218354 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218356 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218359 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218361 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218364 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218366 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218369 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218371 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218374 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218379 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218382 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218385 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.222387 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218389 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218392 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218394 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218397 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218399 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218402 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218406 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218409 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218411 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218414 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218417 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218419 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218422 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218426 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218429 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218431 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218434 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218437 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218439 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.222856 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218442 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218444 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218447 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218450 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218452 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218455 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218457 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218461 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218465 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218470 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218473 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218475 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218478 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218481 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218483 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218486 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218488 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218491 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218494 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.223350 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218497 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218500 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.218502 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218569 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218578 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218586 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218593 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218602 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218607 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218611 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218615 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218618 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218621 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218625 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218629 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218632 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218635 2575 flags.go:64] FLAG: --cgroup-root="" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218637 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218640 2575 flags.go:64] FLAG: --client-ca-file="" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218643 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218646 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218650 2575 flags.go:64] FLAG: --cluster-domain="" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218653 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218656 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 16:24:15.223840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218659 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218662 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218666 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218669 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218672 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218675 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218678 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218681 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218686 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218689 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218692 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218696 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218699 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218702 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218705 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218709 2575 flags.go:64] FLAG: --enable-server="true" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218713 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218716 2575 flags.go:64] FLAG: --event-burst="100" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218719 2575 flags.go:64] FLAG: --event-qps="50" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218722 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218725 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218728 2575 flags.go:64] FLAG: --eviction-hard="" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218732 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218734 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218737 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 16:24:15.224435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218740 2575 flags.go:64] FLAG: --eviction-soft="" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218743 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218746 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218749 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218752 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218755 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218758 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218761 2575 flags.go:64] FLAG: --feature-gates="" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218764 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218767 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218770 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218773 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218776 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218779 2575 flags.go:64] FLAG: --help="false" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218782 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218786 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218789 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218792 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218795 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218798 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218801 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218804 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218808 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 16:24:15.225040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218811 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218814 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218817 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218820 2575 flags.go:64] FLAG: --kube-reserved="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218823 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218826 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218829 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218832 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218834 2575 flags.go:64] FLAG: --lock-file="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218837 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218840 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218843 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218848 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218851 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218854 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218856 2575 flags.go:64] FLAG: --logging-format="text" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218859 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218863 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218866 2575 flags.go:64] FLAG: --manifest-url="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218868 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218872 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218876 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218879 2575 flags.go:64] FLAG: --max-pods="110" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218882 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218887 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 16:24:15.225646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218889 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218892 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218895 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218898 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218901 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218909 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218913 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218917 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218920 2575 flags.go:64] FLAG: --pod-cidr="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218923 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218928 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218931 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218934 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218937 2575 flags.go:64] FLAG: --port="10250" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218940 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218943 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-073fd866bcf3c1072" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218947 2575 flags.go:64] FLAG: --qos-reserved="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218950 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218953 2575 flags.go:64] FLAG: --register-node="true" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218955 2575 flags.go:64] FLAG: --register-with-taints="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218959 2575 flags.go:64] FLAG: --registry-burst="10" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218962 2575 flags.go:64] FLAG: --registry-qps="5" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218965 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218968 2575 flags.go:64] FLAG: --reserved-memory="" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218971 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 16:24:15.226267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218974 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218977 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218980 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218983 2575 flags.go:64] FLAG: --runonce="false" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218986 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218989 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218992 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218995 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.218998 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219001 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219004 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219007 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219010 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219013 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219017 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219019 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219022 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219026 2575 flags.go:64] FLAG: --system-cgroups="" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219029 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219034 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219037 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219039 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219044 2575 flags.go:64] FLAG: --tls-min-version="" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219047 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219050 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 16:24:15.226855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219052 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219056 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219059 2575 flags.go:64] FLAG: --v="2" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219063 2575 flags.go:64] FLAG: --version="false" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219068 2575 flags.go:64] FLAG: --vmodule="" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219071 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.219074 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219189 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219193 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219196 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219199 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219202 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219205 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219208 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219211 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219214 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219217 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219234 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219236 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219239 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219241 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219246 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.227503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219249 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219251 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219254 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219257 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219260 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219263 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219265 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219268 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219271 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219273 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219277 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219281 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219283 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219286 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219289 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219291 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219294 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219296 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219299 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.228040 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219301 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219304 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219306 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219309 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219311 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219314 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219316 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219319 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219321 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219324 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219326 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219329 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219333 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219336 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219339 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219341 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219344 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219347 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219350 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219352 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.228530 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219355 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219357 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219360 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219362 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219365 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219368 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219370 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219373 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219375 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219378 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219380 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219382 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219385 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219387 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219390 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219393 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219396 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219398 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219401 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.229325 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219405 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219410 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219413 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219416 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219419 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219423 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219426 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219430 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219432 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219435 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219438 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219441 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219445 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219448 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219450 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219453 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219456 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219459 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219461 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219464 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.229907 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219466 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219469 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219471 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219474 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219476 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.219479 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.220043 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.226844 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.226858 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.226877 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.226883 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226932 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226937 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226941 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226944 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.230418 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226947 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226950 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226953 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226956 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226959 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226962 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226965 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226967 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226970 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226973 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226976 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226978 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226980 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226983 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226986 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226988 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226990 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226993 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226995 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.230886 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.226998 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227002 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227006 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227009 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227012 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227015 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227019 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227022 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227024 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227027 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227030 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227033 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227035 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227038 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227040 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227043 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227045 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227048 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227051 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227053 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.231394 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227056 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227058 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227061 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227063 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227066 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227068 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227071 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227073 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227076 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227078 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227081 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227083 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227086 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227088 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227091 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227093 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227095 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227098 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227102 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.231878 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227105 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227107 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227110 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227113 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227115 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227119 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227122 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227125 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227128 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227130 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227133 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227135 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227138 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227141 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227144 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227146 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227149 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227151 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227153 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.232412 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227156 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227158 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227161 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227163 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227166 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227169 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227173 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227176 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227179 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227182 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227185 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227187 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227191 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227194 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227197 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227201 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227204 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.232964 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227206 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.227211 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227342 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227348 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227351 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227354 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227356 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227359 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227362 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227364 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227366 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227369 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227371 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227374 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 16:24:15.233444 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227376 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227379 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227381 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227384 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227386 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227389 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227391 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227394 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227396 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227399 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227401 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227404 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227406 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227409 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227412 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227414 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227417 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227419 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227422 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227425 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 16:24:15.234044 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227427 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227429 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227432 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227434 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227438 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227442 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227444 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227447 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227450 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227453 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227456 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227459 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227461 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227464 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227466 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227469 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227471 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227474 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227476 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 16:24:15.234787 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227479 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227481 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227484 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227486 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227489 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227491 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227494 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227496 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227499 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227501 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227504 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227507 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227509 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227512 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227514 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227517 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227520 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227523 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227525 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 16:24:15.235262 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227528 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227530 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227532 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227535 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227537 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227540 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227542 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227544 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227547 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227549 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227552 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227555 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227557 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227560 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227562 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227566 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227569 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227572 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227575 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227578 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 16:24:15.235992 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227580 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227583 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227585 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227588 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227591 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227593 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227596 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227598 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:15.227600 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.227605 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.227708 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.230973 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.232456 2575 server.go:1019] "Starting client certificate rotation" Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.232567 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:24:15.236500 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.232607 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 16:24:15.236861 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.234596 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:24:15.236861 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.235687 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 16:24:15.244580 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.244564 2575 log.go:25] "Validated CRI v1 runtime API" Jul 27 16:24:15.246830 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.246813 2575 log.go:25] "Validated CRI v1 image API" Jul 27 16:24:15.250197 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.250183 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 16:24:15.252439 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.252420 2575 fs.go:135] Filesystem UUIDs: map[1b9131d3-608e-48ce-8182-23523eabfa39:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 96dbf6a2-912c-4735-aa9d-85b4aada1f07:/dev/nvme0n1p4] Jul 27 16:24:15.252504 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.252439 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 16:24:15.257342 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.257207 2575 manager.go:216] Machine: {Timestamp:2026-07-27 16:24:15.255958722 +0000 UTC m=+0.289270319 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113827 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7f1fe906394d6ab8bb177598a383 SystemUUID:ec2c7f1f-e906-394d-6ab8-bb177598a383 BootID:e32fdb5d-bfaf-4317-940a-caa19bcdfab3 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cf:e1:fb:02:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cf:e1:fb:02:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:b1:5c:cb:50:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 16:24:15.257342 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.257340 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 16:24:15.257450 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.257439 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 16:24:15.259792 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.259768 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 16:24:15.259917 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.259794 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 16:24:15.260396 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.260386 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 16:24:15.260426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.260399 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 16:24:15.260426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.260407 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:24:15.261092 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.261082 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 16:24:15.262174 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.262163 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 16:24:15.263809 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263796 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:24:15.263914 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263905 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 16:24:15.263966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263934 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 27 16:24:15.263966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263944 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 16:24:15.263966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263954 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 16:24:15.263966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263962 2575 kubelet.go:398] "Adding apiserver pod source" Jul 27 16:24:15.264116 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.263971 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 16:24:15.264324 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.264312 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:24:15.264367 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.264338 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 16:24:15.266159 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.266130 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:24:15.268824 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.268801 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 16:24:15.271026 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.271012 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 16:24:15.271079 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.271042 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 16:24:15.272523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272511 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272527 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272533 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272539 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272547 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272553 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272560 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 16:24:15.272567 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272565 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 16:24:15.272751 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272572 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 16:24:15.272751 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272577 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 16:24:15.272751 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272585 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 16:24:15.272751 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.272590 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 16:24:15.273345 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.273336 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 16:24:15.273345 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.273345 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 16:24:15.275915 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.275885 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 16:24:15.275985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.275920 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 16:24:15.275985 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.275964 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 16:24:15.276401 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.276388 2575 server.go:1268] "Started kubelet" Jul 27 16:24:15.276632 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.276492 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 16:24:15.276696 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.276662 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 16:24:15.276742 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.276460 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 16:24:15.277123 ip-10-0-128-172 systemd[1]: Started Kubernetes Kubelet. Jul 27 16:24:15.278470 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.278449 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 27 16:24:15.278549 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.278485 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 16:24:15.280352 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.280322 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 16:24:15.286100 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286081 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 16:24:15.286100 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286094 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 16:24:15.286268 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.286143 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.286750 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286733 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 16:24:15.286750 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286754 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 16:24:15.286750 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286726 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 16:24:15.286979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286840 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 27 16:24:15.286979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286848 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 27 16:24:15.286979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286870 2575 factory.go:55] Registering systemd factory Jul 27 16:24:15.286979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.286885 2575 factory.go:223] Registration of the systemd container factory successfully Jul 27 16:24:15.287143 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287129 2575 factory.go:153] Registering CRI-O factory Jul 27 16:24:15.287198 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287148 2575 factory.go:223] Registration of the crio container factory successfully Jul 27 16:24:15.287271 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287196 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 16:24:15.287271 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287241 2575 factory.go:103] Registering Raw factory Jul 27 16:24:15.287271 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287257 2575 manager.go:1196] Started watching for new ooms in manager Jul 27 16:24:15.287619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.287603 2575 manager.go:349] Starting recovery of all containers Jul 27 16:24:15.288610 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.287780 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294d9ffaa6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.27635831 +0000 UTC m=+0.309669906,LastTimestamp:2026-07-27 16:24:15.27635831 +0000 UTC m=+0.309669906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.290086 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.290063 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 16:24:15.290086 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.290072 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 16:24:15.298502 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.298485 2575 manager.go:354] Recovery completed Jul 27 16:24:15.303417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.303405 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.305194 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305176 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.305273 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305204 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.305307 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305276 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.305728 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305715 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 16:24:15.305728 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305726 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 16:24:15.305841 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305740 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 27 16:24:15.305841 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.305719 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.306452 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.306437 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.306507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.306466 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.306507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.306476 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.306909 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.306827 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f57ef93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305191315 +0000 UTC m=+0.338502912,LastTimestamp:2026-07-27 16:24:15.305191315 +0000 UTC m=+0.338502912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.307786 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.307774 2575 policy_none.go:49] "None policy: Start" Jul 27 16:24:15.307831 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.307789 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 16:24:15.307831 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.307801 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 16:24:15.308754 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.308744 2575 policy_none.go:47] "Start" Jul 27 16:24:15.316529 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.316466 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f583d78 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305211256 +0000 UTC m=+0.338522854,LastTimestamp:2026-07-27 16:24:15.305211256 +0000 UTC m=+0.338522854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.332209 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.332000 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f5958c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305283783 +0000 UTC m=+0.338595379,LastTimestamp:2026-07-27 16:24:15.305283783 +0000 UTC m=+0.338595379,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.343561 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.343504 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-172.ec2.internal.18c632294f57ef93\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f57ef93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305191315 +0000 UTC m=+0.338502912,LastTimestamp:2026-07-27 16:24:15.306452198 +0000 UTC m=+0.339763797,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.349463 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349450 2575 manager.go:337] "Starting Device Plugin manager" Jul 27 16:24:15.349513 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.349479 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 16:24:15.349513 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349488 2575 server.go:87] "Starting device plugin registration server" Jul 27 16:24:15.349691 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349677 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 16:24:15.349732 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349692 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 16:24:15.349806 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349792 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 16:24:15.349895 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349884 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 16:24:15.349895 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.349894 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 16:24:15.350363 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.350346 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 16:24:15.350438 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.350396 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.354430 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.354375 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-172.ec2.internal.18c632294f583d78\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f583d78 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305211256 +0000 UTC m=+0.338522854,LastTimestamp:2026-07-27 16:24:15.306471358 +0000 UTC m=+0.339782955,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.368792 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.368736 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-172.ec2.internal.18c632294f5958c7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c632294f5958c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-172.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.305283783 +0000 UTC m=+0.338595379,LastTimestamp:2026-07-27 16:24:15.306480375 +0000 UTC m=+0.339791972,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.376367 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.376311 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-172.ec2.internal.18c6322952a53151 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-172.ec2.internal,UID:ip-10-0-128-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-172.ec2.internal,},FirstTimestamp:2026-07-27 16:24:15.360586065 +0000 UTC m=+0.393897649,LastTimestamp:2026-07-27 16:24:15.360586065 +0000 UTC m=+0.393897649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-172.ec2.internal,}" Jul 27 16:24:15.394721 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.394702 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmnzq" Jul 27 16:24:15.404831 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.404808 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmnzq" Jul 27 16:24:15.450428 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.450402 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.451521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.451297 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.451521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.451323 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.451521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.451335 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.451521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.451362 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.452233 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.452196 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 16:24:15.453386 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.453364 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 16:24:15.453480 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.453399 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 16:24:15.453480 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.453420 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 16:24:15.453480 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.453454 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 16:24:15.465515 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.465472 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:15.471899 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.471884 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.471946 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.471907 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-172.ec2.internal\": node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.518980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.518957 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.554049 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.554026 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal"] Jul 27 16:24:15.554124 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.554109 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.554937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.554918 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.555052 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.554955 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.555052 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.554968 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.556064 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556053 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.556189 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.556256 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556212 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.556801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556785 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.556867 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556816 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.556867 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.556831 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.557459 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.557440 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.557535 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.557468 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.557535 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.557478 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.558566 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.558553 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.558626 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.558577 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 16:24:15.559202 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.559184 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientMemory" Jul 27 16:24:15.559299 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.559213 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 16:24:15.559299 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.559239 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeHasSufficientPID" Jul 27 16:24:15.575725 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.575707 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-172.ec2.internal\" not found" node="ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.579492 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.579477 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-172.ec2.internal\" not found" node="ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.588924 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.588898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.589012 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.588930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.589012 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.588947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5478dd9fd1b137f838abb934e41d00b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"5478dd9fd1b137f838abb934e41d00b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.619250 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.619232 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.689098 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.689098 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.689268 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5478dd9fd1b137f838abb934e41d00b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"5478dd9fd1b137f838abb934e41d00b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.689268 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5478dd9fd1b137f838abb934e41d00b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-172.ec2.internal\" (UID: \"5478dd9fd1b137f838abb934e41d00b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.689268 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.689268 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.689179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24bb3ea8336baea286ae60eb0065aa57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal\" (UID: \"24bb3ea8336baea286ae60eb0065aa57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.720211 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.720159 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.822783 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.822752 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:15.881387 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.881356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.883617 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:15.883593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:15.923395 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:15.923365 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:16.025720 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:16.025651 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:16.128442 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:16.128414 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:16.229299 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:16.229262 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:16.231595 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.231577 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 16:24:16.231762 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.231744 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 16:24:16.288697 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.288620 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:16.330370 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:16.330338 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-172.ec2.internal\" not found" Jul 27 16:24:16.335657 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.335642 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:16.386702 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.386676 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" Jul 27 16:24:16.404828 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.404808 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:24:16.405515 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.405503 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" Jul 27 16:24:16.412044 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.412020 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 16:19:16 +0000 UTC" deadline="2028-02-14 00:43:31.297993964 +0000 UTC" Jul 27 16:24:16.412044 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.412043 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13592h19m14.885954213s" Jul 27 16:24:16.419487 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.419470 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 16:24:16.574764 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:16.574732 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5478dd9fd1b137f838abb934e41d00b1.slice/crio-ac0862928bc1f35140171bc6a22c7847eff1fd8f3e74305a9ed44961051fb1da WatchSource:0}: Error finding container ac0862928bc1f35140171bc6a22c7847eff1fd8f3e74305a9ed44961051fb1da: Status 404 returned error can't find the container with id ac0862928bc1f35140171bc6a22c7847eff1fd8f3e74305a9ed44961051fb1da Jul 27 16:24:16.575257 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:16.575235 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bb3ea8336baea286ae60eb0065aa57.slice/crio-9b7c87ea79d7cd066ad1fbab1158a7c02f59e25da7b4dffeea8c28d8e0c9ddf6 WatchSource:0}: Error finding container 9b7c87ea79d7cd066ad1fbab1158a7c02f59e25da7b4dffeea8c28d8e0c9ddf6: Status 404 returned error can't find the container with id 9b7c87ea79d7cd066ad1fbab1158a7c02f59e25da7b4dffeea8c28d8e0c9ddf6 Jul 27 16:24:16.581482 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.581467 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:24:16.869514 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:16.869428 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:17.249165 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.249079 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 16:24:17.264295 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.264262 2575 apiserver.go:52] "Watching apiserver" Jul 27 16:24:17.270637 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.270620 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 16:24:17.270989 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.270970 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9bkmb","openshift-network-operator/iptables-alerter-kjmms","openshift-ovn-kubernetes/ovnkube-node-knsrr","kube-system/global-pull-secret-syncer-j69dd","openshift-cluster-node-tuning-operator/tuned-25wn9","openshift-dns/node-resolver-lptsj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal","openshift-multus/multus-sm72l","openshift-multus/network-metrics-daemon-56rvn","kube-system/konnectivity-agent-mgsgk","kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw","openshift-image-registry/node-ca-wfwbd","openshift-multus/multus-additional-cni-plugins-hwmt6"] Jul 27 16:24:17.273313 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.273293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.274608 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.274590 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.275501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.275471 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.275623 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.275534 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 16:24:17.275623 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.275580 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.275623 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.275582 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kmk72\"" Jul 27 16:24:17.275838 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.275817 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.275959 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.275878 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:17.276565 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.276548 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 16:24:17.276730 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.276710 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 16:24:17.276954 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.276934 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-92v7b\"" Jul 27 16:24:17.277069 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.277000 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 16:24:17.277069 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.277026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.277227 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.277187 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 16:24:17.277314 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.277232 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.277314 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.277272 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.278586 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.278566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.280109 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.280208 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.280152 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:17.280364 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280343 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.280483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280450 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.280483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280476 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.280591 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280564 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lqcs8\"" Jul 27 16:24:17.280646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280608 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-47rph\"" Jul 27 16:24:17.280748 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.280731 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.283719 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.281773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:17.283719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.281892 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:17.284954 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.284935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.286483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.286464 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 16:24:17.286575 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.286497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.287023 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.287002 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.287137 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.287120 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 16:24:17.287210 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.287166 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.287543 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.287526 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mdhdl\"" Jul 27 16:24:17.288113 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.288095 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.288523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.288501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-spkfk\"" Jul 27 16:24:17.289012 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.288999 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 16:24:17.289085 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.289025 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 16:24:17.289691 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.289675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.291139 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 16:24:17.291360 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291346 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 16:24:17.291463 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.291540 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291524 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.291600 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291555 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.291600 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291577 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 16:24:17.291692 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.291526 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hvxwl\"" Jul 27 16:24:17.292243 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.292217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 16:24:17.292482 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.292466 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 16:24:17.292482 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.292479 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7n6v\"" Jul 27 16:24:17.292621 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.292489 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 16:24:17.295085 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.295065 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 16:24:17.295342 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.295327 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vfrsd\"" Jul 27 16:24:17.299239 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-systemd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.299339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299226 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eccc9870-4298-46a4-b6dd-240a2f583e46-host\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.299339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eccc9870-4298-46a4-b6dd-240a2f583e46-serviceca\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.299339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-lib-modules\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.299339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-var-lib-kubelet\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.299339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-var-lib-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-env-overrides\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtj4f\" (UniqueName: \"kubernetes.io/projected/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-kube-api-access-dtj4f\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299415 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299434 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-kubelet-config\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-kubernetes\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-ovn\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-system-cni-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-systemd\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299520 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-sys\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.299596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6c9b\" (UniqueName: \"kubernetes.io/projected/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-kube-api-access-l6c9b\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-kubelet\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-node-log\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-host\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-etc-tuned\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-bin\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-cnibin\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-dbus\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzv9j\" (UniqueName: \"kubernetes.io/projected/7a781d7c-2868-4b94-b094-253a1ed517cc-kube-api-access-hzv9j\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9363e8f6-7788-4d4f-91cb-f04458c9e760-agent-certs\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grtfk\" (UniqueName: \"kubernetes.io/projected/eccc9870-4298-46a4-b6dd-240a2f583e46-kube-api-access-grtfk\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-slash\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-script-lib\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300133 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-tmp-dir\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4thsv\" (UniqueName: \"kubernetes.io/projected/195be682-e8bc-4574-8db4-e87bcd9436f5-kube-api-access-4thsv\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.299996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a781d7c-2868-4b94-b094-253a1ed517cc-ovn-node-metrics-cert\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysconfig\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-conf\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300119 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-config\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-hosts-file\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmr8h\" (UniqueName: \"kubernetes.io/projected/4c56d98b-7209-4213-a92b-05df304efbff-kube-api-access-fmr8h\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-netns\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c56d98b-7209-4213-a92b-05df304efbff-iptables-alerter-script\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-netd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-tmp\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.300937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q26jk\" (UniqueName: \"kubernetes.io/projected/8923ee9e-642d-494e-8c60-3ef268841a09-kube-api-access-q26jk\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-os-release\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-run\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-systemd-units\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-log-socket\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c56d98b-7209-4213-a92b-05df304efbff-host-slash\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-etc-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9363e8f6-7788-4d4f-91cb-f04458c9e760-konnectivity-ca\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.300553 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-modprobe-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.301829 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.301390 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 16:24:17.337227 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.337207 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qp8zq" Jul 27 16:24:17.345663 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.345641 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qp8zq" Jul 27 16:24:17.388109 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.388082 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 16:24:17.400867 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.400840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-etc-tuned\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.400974 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.400877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-k8s-cni-cncf-io\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.400974 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.400904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.400974 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.400930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:17.401140 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401140 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401140 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-bin\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-cnibin\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401162 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-dbus\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzv9j\" (UniqueName: \"kubernetes.io/projected/7a781d7c-2868-4b94-b094-253a1ed517cc-kube-api-access-hzv9j\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9363e8f6-7788-4d4f-91cb-f04458c9e760-agent-certs\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-bin\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grtfk\" (UniqueName: \"kubernetes.io/projected/eccc9870-4298-46a4-b6dd-240a2f583e46-kube-api-access-grtfk\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-cnibin\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-registration-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.401328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-slash\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-kubelet\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401391 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-multus-certs\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-slash\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-script-lib\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-tmp-dir\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401458 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-dbus\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4thsv\" (UniqueName: \"kubernetes.io/projected/195be682-e8bc-4574-8db4-e87bcd9436f5-kube-api-access-4thsv\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zglf8\" (UniqueName: \"kubernetes.io/projected/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-kube-api-access-zglf8\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a781d7c-2868-4b94-b094-253a1ed517cc-ovn-node-metrics-cert\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzhj\" (UniqueName: \"kubernetes.io/projected/751021a0-c86d-4614-89a6-c8312deafd66-kube-api-access-jrzhj\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-socket-dir-parent\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401713 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-netns\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-tmp-dir\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.401848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401821 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysconfig\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-conf\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-config\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-hosts-file\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmr8h\" (UniqueName: \"kubernetes.io/projected/4c56d98b-7209-4213-a92b-05df304efbff-kube-api-access-fmr8h\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-netns\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.401991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c56d98b-7209-4213-a92b-05df304efbff-iptables-alerter-script\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-netd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402052 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402058 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysctl-conf\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402122 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-tmp\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402131 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-sysconfig\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402146 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q26jk\" (UniqueName: \"kubernetes.io/projected/8923ee9e-642d-494e-8c60-3ef268841a09-kube-api-access-q26jk\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-sys-fs\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-system-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-os-release\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.402673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402248 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-script-lib\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-etc-selinux\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-os-release\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-run-netns\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-run\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-systemd-units\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-log-socket\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402455 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-os-release\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-hostroot\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402495 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c56d98b-7209-4213-a92b-05df304efbff-host-slash\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-etc-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9363e8f6-7788-4d4f-91cb-f04458c9e760-konnectivity-ca\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.402570 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-modprobe-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.403551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-multus\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.402667 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:17.902621612 +0000 UTC m=+2.935933219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-systemd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402756 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-systemd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402829 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-run\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402876 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402888 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c56d98b-7209-4213-a92b-05df304efbff-iptables-alerter-script\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402950 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-hosts-file\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.402960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-cni-netd\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403003 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-log-socket\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403033 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-ovnkube-config\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-systemd-units\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403090 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c56d98b-7209-4213-a92b-05df304efbff-host-slash\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403130 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403173 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-etc-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403316 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-modprobe-d\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eccc9870-4298-46a4-b6dd-240a2f583e46-host\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.404426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eccc9870-4298-46a4-b6dd-240a2f583e46-serviceca\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-lib-modules\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-bin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-var-lib-kubelet\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-var-lib-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-env-overrides\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtj4f\" (UniqueName: \"kubernetes.io/projected/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-kube-api-access-dtj4f\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-kubelet-config\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-kubernetes\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cnibin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-ovn\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-system-cni-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9363e8f6-7788-4d4f-91cb-f04458c9e760-konnectivity-ca\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-systemd\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405286 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403811 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-var-lib-openvswitch\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-sys\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403846 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-systemd\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403860 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eccc9870-4298-46a4-b6dd-240a2f583e46-host\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6c9b\" (UniqueName: \"kubernetes.io/projected/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-kube-api-access-l6c9b\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-socket-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-daemon-config\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.403969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-kubelet\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-node-log\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-host\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-device-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cni-binary-copy\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-conf-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404204 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-etc-kubernetes\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.405865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404272 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eccc9870-4298-46a4-b6dd-240a2f583e46-serviceca\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-node-log\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-host\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a781d7c-2868-4b94-b094-253a1ed517cc-env-overrides\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195be682-e8bc-4574-8db4-e87bcd9436f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404802 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-sys\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404871 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-etc-kubernetes\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-lib-modules\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.404900 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404912 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195be682-e8bc-4574-8db4-e87bcd9436f5-system-cni-dir\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404941 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-host-kubelet\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404967 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a781d7c-2868-4b94-b094-253a1ed517cc-run-ovn\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.404952 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-kubelet-config\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.405020 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:17.905000628 +0000 UTC m=+2.938312230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.405081 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8923ee9e-642d-494e-8c60-3ef268841a09-var-lib-kubelet\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.405192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-etc-tuned\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.405334 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a781d7c-2868-4b94-b094-253a1ed517cc-ovn-node-metrics-cert\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.406429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.405430 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9363e8f6-7788-4d4f-91cb-f04458c9e760-agent-certs\") pod \"konnectivity-agent-mgsgk\" (UID: \"9363e8f6-7788-4d4f-91cb-f04458c9e760\") " pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.407018 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.405441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8923ee9e-642d-494e-8c60-3ef268841a09-tmp\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.409876 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.409858 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:17.409930 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.409883 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:17.409930 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.409892 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:17.410020 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.409938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:17.909922923 +0000 UTC m=+2.943234513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:17.412078 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.412055 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmr8h\" (UniqueName: \"kubernetes.io/projected/4c56d98b-7209-4213-a92b-05df304efbff-kube-api-access-fmr8h\") pod \"iptables-alerter-kjmms\" (UID: \"4c56d98b-7209-4213-a92b-05df304efbff\") " pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.412707 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.412676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grtfk\" (UniqueName: \"kubernetes.io/projected/eccc9870-4298-46a4-b6dd-240a2f583e46-kube-api-access-grtfk\") pod \"node-ca-wfwbd\" (UID: \"eccc9870-4298-46a4-b6dd-240a2f583e46\") " pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.413362 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.413340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzv9j\" (UniqueName: \"kubernetes.io/projected/7a781d7c-2868-4b94-b094-253a1ed517cc-kube-api-access-hzv9j\") pod \"ovnkube-node-knsrr\" (UID: \"7a781d7c-2868-4b94-b094-253a1ed517cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.413522 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.413498 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4thsv\" (UniqueName: \"kubernetes.io/projected/195be682-e8bc-4574-8db4-e87bcd9436f5-kube-api-access-4thsv\") pod \"multus-additional-cni-plugins-hwmt6\" (UID: \"195be682-e8bc-4574-8db4-e87bcd9436f5\") " pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.413669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.413652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q26jk\" (UniqueName: \"kubernetes.io/projected/8923ee9e-642d-494e-8c60-3ef268841a09-kube-api-access-q26jk\") pod \"tuned-25wn9\" (UID: \"8923ee9e-642d-494e-8c60-3ef268841a09\") " pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.414193 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.414176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtj4f\" (UniqueName: \"kubernetes.io/projected/b0d5637d-0f66-47f6-bc31-67c73cd78b4c-kube-api-access-dtj4f\") pod \"node-resolver-lptsj\" (UID: \"b0d5637d-0f66-47f6-bc31-67c73cd78b4c\") " pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.414432 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.414416 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6c9b\" (UniqueName: \"kubernetes.io/projected/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-kube-api-access-l6c9b\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.459401 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.459356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"24bb3ea8336baea286ae60eb0065aa57","Type":"ContainerStarted","Data":"9b7c87ea79d7cd066ad1fbab1158a7c02f59e25da7b4dffeea8c28d8e0c9ddf6"} Jul 27 16:24:17.460523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.460501 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" event={"ID":"5478dd9fd1b137f838abb934e41d00b1","Type":"ContainerStarted","Data":"ac0862928bc1f35140171bc6a22c7847eff1fd8f3e74305a9ed44961051fb1da"} Jul 27 16:24:17.505587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cnibin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-socket-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.505587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-daemon-config\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-device-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505632 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cni-binary-copy\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-conf-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cnibin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-etc-kubernetes\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-device-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505720 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-etc-kubernetes\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-k8s-cni-cncf-io\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-conf-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-socket-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.505800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-k8s-cni-cncf-io\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-registration-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-kubelet\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-multus-certs\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-registration-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505924 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-kubelet\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zglf8\" (UniqueName: \"kubernetes.io/projected/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-kube-api-access-zglf8\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505942 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-multus-certs\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzhj\" (UniqueName: \"kubernetes.io/projected/751021a0-c86d-4614-89a6-c8312deafd66-kube-api-access-jrzhj\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-socket-dir-parent\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.505992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-netns\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-sys-fs\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-system-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-etc-selinux\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-os-release\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-socket-dir-parent\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-hostroot\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-multus\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-system-cni-dir\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-bin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506177 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-os-release\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-run-netns\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-hostroot\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-bin\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506211 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-multus-daemon-config\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-cni-binary-copy\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506285 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-sys-fs\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506365 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-host-var-lib-cni-multus\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.506959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.506419 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/751021a0-c86d-4614-89a6-c8312deafd66-etc-selinux\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.515277 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.515254 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zglf8\" (UniqueName: \"kubernetes.io/projected/f7d0e52b-0332-437c-af6d-4c3b8eca48b7-kube-api-access-zglf8\") pod \"multus-sm72l\" (UID: \"f7d0e52b-0332-437c-af6d-4c3b8eca48b7\") " pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.515384 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.515302 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzhj\" (UniqueName: \"kubernetes.io/projected/751021a0-c86d-4614-89a6-c8312deafd66-kube-api-access-jrzhj\") pod \"aws-ebs-csi-driver-node-v4nsw\" (UID: \"751021a0-c86d-4614-89a6-c8312deafd66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.587698 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.587658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfwbd" Jul 27 16:24:17.591741 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.591720 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:17.597503 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.597477 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccc9870_4298_46a4_b6dd_240a2f583e46.slice/crio-7bbb14423edfb2802910d2354af0888327e1438f0edb5ecf05bca5f2ce4db0be WatchSource:0}: Error finding container 7bbb14423edfb2802910d2354af0888327e1438f0edb5ecf05bca5f2ce4db0be: Status 404 returned error can't find the container with id 7bbb14423edfb2802910d2354af0888327e1438f0edb5ecf05bca5f2ce4db0be Jul 27 16:24:17.598736 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.598720 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25wn9" Jul 27 16:24:17.599559 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.599497 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a781d7c_2868_4b94_b094_253a1ed517cc.slice/crio-6efa03655ede24568e3c5484ffb103fa4e4e0a18f0d452bb6321f7e6895e6f0b WatchSource:0}: Error finding container 6efa03655ede24568e3c5484ffb103fa4e4e0a18f0d452bb6321f7e6895e6f0b: Status 404 returned error can't find the container with id 6efa03655ede24568e3c5484ffb103fa4e4e0a18f0d452bb6321f7e6895e6f0b Jul 27 16:24:17.604340 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.604291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lptsj" Jul 27 16:24:17.608159 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.608138 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8923ee9e_642d_494e_8c60_3ef268841a09.slice/crio-9ccc216249e7542647e8da05fd4c934d75d998443c3cd5423c163f89c7f17df8 WatchSource:0}: Error finding container 9ccc216249e7542647e8da05fd4c934d75d998443c3cd5423c163f89c7f17df8: Status 404 returned error can't find the container with id 9ccc216249e7542647e8da05fd4c934d75d998443c3cd5423c163f89c7f17df8 Jul 27 16:24:17.611842 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.611824 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjmms" Jul 27 16:24:17.612930 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.612910 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d5637d_0f66_47f6_bc31_67c73cd78b4c.slice/crio-d8d9fe8dc9187269dc43b82eb423ef921e576fb502375c42b831908fd592bdc8 WatchSource:0}: Error finding container d8d9fe8dc9187269dc43b82eb423ef921e576fb502375c42b831908fd592bdc8: Status 404 returned error can't find the container with id d8d9fe8dc9187269dc43b82eb423ef921e576fb502375c42b831908fd592bdc8 Jul 27 16:24:17.617054 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.617010 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:17.620168 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.620152 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c56d98b_7209_4213_a92b_05df304efbff.slice/crio-0a338ca8ba93bf70a59e18d1ba4a9aa8411358f9e0d9ddc00516cefc51cea313 WatchSource:0}: Error finding container 0a338ca8ba93bf70a59e18d1ba4a9aa8411358f9e0d9ddc00516cefc51cea313: Status 404 returned error can't find the container with id 0a338ca8ba93bf70a59e18d1ba4a9aa8411358f9e0d9ddc00516cefc51cea313 Jul 27 16:24:17.622292 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.622252 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" Jul 27 16:24:17.625270 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.625250 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9363e8f6_7788_4d4f_91cb_f04458c9e760.slice/crio-f4a7c4ed72d7087ac063e670996e9580f5498502794f625216d5325e883c30a9 WatchSource:0}: Error finding container f4a7c4ed72d7087ac063e670996e9580f5498502794f625216d5325e883c30a9: Status 404 returned error can't find the container with id f4a7c4ed72d7087ac063e670996e9580f5498502794f625216d5325e883c30a9 Jul 27 16:24:17.628744 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.628727 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" Jul 27 16:24:17.630199 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.630164 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195be682_e8bc_4574_8db4_e87bcd9436f5.slice/crio-c4fcd6f433d537610b676ce2fbb943b6743d6f70232e7f01a839b5c4766dd563 WatchSource:0}: Error finding container c4fcd6f433d537610b676ce2fbb943b6743d6f70232e7f01a839b5c4766dd563: Status 404 returned error can't find the container with id c4fcd6f433d537610b676ce2fbb943b6743d6f70232e7f01a839b5c4766dd563 Jul 27 16:24:17.633431 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.633408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm72l" Jul 27 16:24:17.637233 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.637206 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751021a0_c86d_4614_89a6_c8312deafd66.slice/crio-c2fd3b9760752fb92cf73a6574303f4c5df1811690a468693c8ba70aa76dbb20 WatchSource:0}: Error finding container c2fd3b9760752fb92cf73a6574303f4c5df1811690a468693c8ba70aa76dbb20: Status 404 returned error can't find the container with id c2fd3b9760752fb92cf73a6574303f4c5df1811690a468693c8ba70aa76dbb20 Jul 27 16:24:17.640852 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:17.640827 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d0e52b_0332_437c_af6d_4c3b8eca48b7.slice/crio-e9aef140fa26a65b90e13b0919e282e60887b9978932756f74ff0c63aa625ce9 WatchSource:0}: Error finding container e9aef140fa26a65b90e13b0919e282e60887b9978932756f74ff0c63aa625ce9: Status 404 returned error can't find the container with id e9aef140fa26a65b90e13b0919e282e60887b9978932756f74ff0c63aa625ce9 Jul 27 16:24:17.910854 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.910750 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:17.910854 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.910802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:17.910854 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:17.910836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.910885 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.910932 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.910961 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:18.910940521 +0000 UTC m=+3.944252125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.910978 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:18.910971611 +0000 UTC m=+3.944283197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.910960 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.911048 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.911063 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:17.911109 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:17.911112 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:18.911098163 +0000 UTC m=+3.944409761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:18.347952 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.347819 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:19:17 +0000 UTC" deadline="2028-02-27 15:14:42.833930274 +0000 UTC" Jul 27 16:24:18.347952 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.347897 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13918h50m24.486037858s" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.454450 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.454586 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.455079 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.455186 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.455257 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:18.457276 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.455373 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:18.471889 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.471790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm72l" event={"ID":"f7d0e52b-0332-437c-af6d-4c3b8eca48b7","Type":"ContainerStarted","Data":"e9aef140fa26a65b90e13b0919e282e60887b9978932756f74ff0c63aa625ce9"} Jul 27 16:24:18.479970 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.479651 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" event={"ID":"751021a0-c86d-4614-89a6-c8312deafd66","Type":"ContainerStarted","Data":"c2fd3b9760752fb92cf73a6574303f4c5df1811690a468693c8ba70aa76dbb20"} Jul 27 16:24:18.488885 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.488853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mgsgk" event={"ID":"9363e8f6-7788-4d4f-91cb-f04458c9e760","Type":"ContainerStarted","Data":"f4a7c4ed72d7087ac063e670996e9580f5498502794f625216d5325e883c30a9"} Jul 27 16:24:18.493097 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.493020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lptsj" event={"ID":"b0d5637d-0f66-47f6-bc31-67c73cd78b4c","Type":"ContainerStarted","Data":"d8d9fe8dc9187269dc43b82eb423ef921e576fb502375c42b831908fd592bdc8"} Jul 27 16:24:18.498208 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.498180 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25wn9" event={"ID":"8923ee9e-642d-494e-8c60-3ef268841a09","Type":"ContainerStarted","Data":"9ccc216249e7542647e8da05fd4c934d75d998443c3cd5423c163f89c7f17df8"} Jul 27 16:24:18.508483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.508339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"6efa03655ede24568e3c5484ffb103fa4e4e0a18f0d452bb6321f7e6895e6f0b"} Jul 27 16:24:18.513501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.513472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfwbd" event={"ID":"eccc9870-4298-46a4-b6dd-240a2f583e46","Type":"ContainerStarted","Data":"7bbb14423edfb2802910d2354af0888327e1438f0edb5ecf05bca5f2ce4db0be"} Jul 27 16:24:18.516030 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.516002 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerStarted","Data":"c4fcd6f433d537610b676ce2fbb943b6743d6f70232e7f01a839b5c4766dd563"} Jul 27 16:24:18.523048 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.523020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjmms" event={"ID":"4c56d98b-7209-4213-a92b-05df304efbff","Type":"ContainerStarted","Data":"0a338ca8ba93bf70a59e18d1ba4a9aa8411358f9e0d9ddc00516cefc51cea313"} Jul 27 16:24:18.917990 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.917950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:18.918200 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.918026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:18.918200 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:18.918069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:18.918350 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918248 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:18.918350 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918288 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:18.918350 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918303 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:18.918515 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918366 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:20.918345952 +0000 UTC m=+5.951657553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:18.918815 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918784 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:18.918909 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918858 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:20.918841184 +0000 UTC m=+5.952152770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:18.919050 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918926 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:18.919050 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:18.918964 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:20.918949243 +0000 UTC m=+5.952260844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:19.349189 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:19.349065 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:19:17 +0000 UTC" deadline="2028-02-23 02:21:27.154460571 +0000 UTC" Jul 27 16:24:19.349189 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:19.349108 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13809h57m7.805357717s" Jul 27 16:24:20.454479 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.454420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:20.454966 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.454637 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:20.455103 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.455037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:20.455164 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.455135 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:20.455219 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.455186 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:20.455274 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.455257 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.939006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.939070 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:20.939121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939252 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939347 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:24.939327679 +0000 UTC m=+9.972639282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939810 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939870 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:24.939850574 +0000 UTC m=+9.973162175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939957 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939972 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.939985 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:20.940059 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:20.940022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:24.94001042 +0000 UTC m=+9.973322019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:22.454028 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:22.453993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:22.454604 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:22.454129 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:22.454604 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:22.454566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:22.454729 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:22.454684 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:22.454803 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:22.454750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:22.454859 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:22.454830 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:24.454649 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.454600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:24.455122 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.454735 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:24.455122 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.455096 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:24.455279 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.455192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:24.455279 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.455260 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:24.455379 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.455318 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:24.974619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.974398 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:24.974619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.974454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:24.974619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:24.974505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:24.974619 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974569 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974646 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:32.974625817 +0000 UTC m=+18.007937415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974647 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974652 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974702 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:32.974687043 +0000 UTC m=+18.007998628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974717 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974740 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:24.974980 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:24.974797 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:32.974781208 +0000 UTC m=+18.008092804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:26.454669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:26.454601 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:26.454669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:26.454599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:26.455290 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:26.454795 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:26.455290 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:26.455187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:26.455406 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:26.455305 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:26.455474 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:26.455440 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:28.454658 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:28.454623 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:28.454658 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:28.454642 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:28.455158 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:28.454622 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:28.455158 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:28.454757 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:28.455158 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:28.454867 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:28.455158 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:28.454927 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:30.453660 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:30.453620 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:30.454131 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:30.453643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:30.454131 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:30.453758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:30.454131 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:30.453750 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:30.454131 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:30.453862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:30.454131 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:30.453967 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:32.453879 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:32.453621 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:32.454328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:32.453665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:32.454328 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:32.453691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:32.454328 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:32.454045 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:32.454328 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:32.454101 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:32.454328 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:32.454233 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:33.038661 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:33.038629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:33.038827 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:33.038678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:33.038827 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:33.038716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:33.038827 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038795 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:33.038827 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038815 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038842 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038858 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038866 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:49.03884843 +0000 UTC m=+34.072160014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038870 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038881 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:49.038873693 +0000 UTC m=+34.072185277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:33.039025 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:33.038915 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:49.03889922 +0000 UTC m=+34.072210818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:34.454261 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:34.454209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:34.454261 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:34.454263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:34.454777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:34.454346 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:34.454777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:34.454403 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:34.454777 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:34.454463 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:34.454777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:34.454545 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:36.454185 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:36.454143 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:36.454677 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:36.454194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:36.454677 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:36.454194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:36.454677 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:36.454295 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:36.454677 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:36.454404 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:36.454677 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:36.454491 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:38.454623 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.454392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:38.455525 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.454449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:38.455525 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:38.454710 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:38.455525 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.454455 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:38.455525 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:38.454826 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:38.455525 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:38.454920 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:38.585284 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.585254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfwbd" event={"ID":"eccc9870-4298-46a4-b6dd-240a2f583e46","Type":"ContainerStarted","Data":"e1788159f3d7fbd00c8d64dc1fab644d7a3fc6b46a7e0057abcd6e1b60fc478b"} Jul 27 16:24:38.586573 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.586550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" event={"ID":"5478dd9fd1b137f838abb934e41d00b1","Type":"ContainerStarted","Data":"fdb3237ba9f05c4f7ed40656dc5eafbb9b5d8a181704a4dd7e26161062f27ed7"} Jul 27 16:24:38.587915 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.587871 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="2dfc28d2fb922bac99bcb939e296c6e4fd3f4876c33e03162815f5a7f9bc9088" exitCode=0 Jul 27 16:24:38.587984 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.587931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"2dfc28d2fb922bac99bcb939e296c6e4fd3f4876c33e03162815f5a7f9bc9088"} Jul 27 16:24:38.589586 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.589567 2575 generic.go:356] "Generic (PLEG): container finished" podID="24bb3ea8336baea286ae60eb0065aa57" containerID="588f8eb1c4da5c8c7a2eadbb23d465c42c9701693f09b6f72161697fe2c46f2f" exitCode=0 Jul 27 16:24:38.589645 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.589629 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"24bb3ea8336baea286ae60eb0065aa57","Type":"ContainerDied","Data":"588f8eb1c4da5c8c7a2eadbb23d465c42c9701693f09b6f72161697fe2c46f2f"} Jul 27 16:24:38.591096 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.591075 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm72l" event={"ID":"f7d0e52b-0332-437c-af6d-4c3b8eca48b7","Type":"ContainerStarted","Data":"1114ff6874d676373af8f8aa7031d1c8e4499e2e1905c5f47f11d58a9d8c7681"} Jul 27 16:24:38.592669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.592638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" event={"ID":"751021a0-c86d-4614-89a6-c8312deafd66","Type":"ContainerStarted","Data":"a5938a0d8be3d11c6404eec8894befb3cbf634da73f389677fb285feba6aa571"} Jul 27 16:24:38.594054 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.594028 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mgsgk" event={"ID":"9363e8f6-7788-4d4f-91cb-f04458c9e760","Type":"ContainerStarted","Data":"55d41af95bfa5e1d6406f3d2c6251f1d825afd3e72d77500d1f9818069c9eccf"} Jul 27 16:24:38.595336 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.595310 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lptsj" event={"ID":"b0d5637d-0f66-47f6-bc31-67c73cd78b4c","Type":"ContainerStarted","Data":"76ac7471907f7962419ffb958b463df0b3f006d482bd29277e0a974380613785"} Jul 27 16:24:38.596731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.596713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25wn9" event={"ID":"8923ee9e-642d-494e-8c60-3ef268841a09","Type":"ContainerStarted","Data":"4162e3ba1ef0169a7353674c9cda981fe04d7c375438887c36d27dfe9c9fc067"} Jul 27 16:24:38.599499 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.599483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"11d61a9bc97ceb8ce6a3af040f6547d135dcb5973fb82256f00450fda7ff1f76"} Jul 27 16:24:38.599548 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.599538 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"090c75da77be5b6f203e67635f70282cb808c16a3118ec52c057bdeef17316cf"} Jul 27 16:24:38.599581 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.599568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"4a39131c4f99aadae1ade88ff7fca3f57289c768c6a029b4821ea3753e6fb80d"} Jul 27 16:24:38.599610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.599598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"969f32d1d34aa8465416d8ed0685a77300bc6a1f96a83ab7e2db26da3cde93c2"} Jul 27 16:24:38.599654 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.599642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"473c6e1d31261de7705c040b472b633e0bfd18bb8018881135c66009545303e0"} Jul 27 16:24:38.602851 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.602795 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wfwbd" podStartSLOduration=2.391566571 podStartE2EDuration="22.602777162s" totalImagesPullingTime="20.211210591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.602030481 +0000 UTC m=+23.635342100" watchObservedRunningTime="2026-07-27 16:24:38.602777162 +0000 UTC m=+23.636088772" Jul 27 16:24:38.623029 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.622846 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sm72l" podStartSLOduration=2.3912955399999998 podStartE2EDuration="22.622833078s" totalImagesPullingTime="20.231537538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.619067421 +0000 UTC m=+23.652379028" watchObservedRunningTime="2026-07-27 16:24:38.622833078 +0000 UTC m=+23.656144684" Jul 27 16:24:38.654054 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.654006 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-172.ec2.internal" podStartSLOduration=21.653988814 podStartE2EDuration="21.653988814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.636390863 +0000 UTC m=+23.669702472" watchObservedRunningTime="2026-07-27 16:24:38.653988814 +0000 UTC m=+23.687300420" Jul 27 16:24:38.654785 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.654744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lptsj" podStartSLOduration=2.457875522 podStartE2EDuration="22.654733435s" totalImagesPullingTime="20.196857913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.654051954 +0000 UTC m=+23.687363561" watchObservedRunningTime="2026-07-27 16:24:38.654733435 +0000 UTC m=+23.688045044" Jul 27 16:24:38.718522 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.718481 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-25wn9" podStartSLOduration=2.499364711 podStartE2EDuration="22.718467138s" totalImagesPullingTime="20.219102427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.718167142 +0000 UTC m=+23.751478746" watchObservedRunningTime="2026-07-27 16:24:38.718467138 +0000 UTC m=+23.751778744" Jul 27 16:24:38.739625 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:38.739585 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mgsgk" podStartSLOduration=2.5554218349999998 podStartE2EDuration="22.739570199s" totalImagesPullingTime="20.184148364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:38.739384469 +0000 UTC m=+23.772696074" watchObservedRunningTime="2026-07-27 16:24:38.739570199 +0000 UTC m=+23.772881805" Jul 27 16:24:39.602885 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:39.602852 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjmms" event={"ID":"4c56d98b-7209-4213-a92b-05df304efbff","Type":"ContainerStarted","Data":"7f08dbcb085ca257009684bc16b2f855e951845048c3c43d803f4fc159ecdfae"} Jul 27 16:24:39.607405 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:39.607344 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" event={"ID":"24bb3ea8336baea286ae60eb0065aa57","Type":"ContainerStarted","Data":"9ab44b449e690fe0b6725cf483c1fc40f6c8a8afb49d89b7982ddacb73f18a69"} Jul 27 16:24:39.610110 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:39.610083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"1a74647fc7bafa0e97a3fa4e4759e1a9b99e8d8e2f1976b8108dee3b4d33a15e"} Jul 27 16:24:39.668417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:39.668368 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kjmms" podStartSLOduration=3.468249641 podStartE2EDuration="23.668348577s" totalImagesPullingTime="20.200098936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:39.629467218 +0000 UTC m=+24.662778823" watchObservedRunningTime="2026-07-27 16:24:39.668348577 +0000 UTC m=+24.701660180" Jul 27 16:24:39.668673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:39.668652 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-172.ec2.internal" podStartSLOduration=23.668646664 podStartE2EDuration="23.668646664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:39.665214166 +0000 UTC m=+24.698525773" watchObservedRunningTime="2026-07-27 16:24:39.668646664 +0000 UTC m=+24.701958269" Jul 27 16:24:40.149296 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.149275 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 16:24:40.364606 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.364416 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T16:24:40.14929179Z","UUID":"cf661d6b-672f-47c5-a08d-83c27e777763","Handler":null,"Name":"","Endpoint":""} Jul 27 16:24:40.365783 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.365764 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 16:24:40.365883 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.365798 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 16:24:40.454198 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.454171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:40.454338 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.454288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:40.454338 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.454299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:40.454338 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:40.454296 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:40.454486 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:40.454364 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:40.454532 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:40.454471 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:40.613830 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:40.613797 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" event={"ID":"751021a0-c86d-4614-89a6-c8312deafd66","Type":"ContainerStarted","Data":"50cac7b1909bfb328bf7af210d7e2ece4110aec18d9e06b3cfc86d4d65a3984b"} Jul 27 16:24:41.621179 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:41.621128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"71c573936661c36f96827a6e34b378dd603de94290f5acf11f79834f6106ffc4"} Jul 27 16:24:42.454267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.454208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:42.454429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.454274 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:42.454429 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.454280 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:42.454429 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:42.454354 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:42.454584 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:42.454473 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:42.454641 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:42.454620 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:42.625501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.625466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" event={"ID":"751021a0-c86d-4614-89a6-c8312deafd66","Type":"ContainerStarted","Data":"5d73e8bd4cb6562195aafcfe4466fa30ffda3eaa55fc2f0e38c576183133ec1d"} Jul 27 16:24:42.647111 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.647062 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v4nsw" podStartSLOduration=2.96346023 podStartE2EDuration="26.647048771s" totalImagesPullingTime="23.683588541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:42.646742468 +0000 UTC m=+27.680054076" watchObservedRunningTime="2026-07-27 16:24:42.647048771 +0000 UTC m=+27.680360377" Jul 27 16:24:42.658682 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.658656 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:42.659342 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:42.659325 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:43.631809 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:43.631509 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" event={"ID":"7a781d7c-2868-4b94-b094-253a1ed517cc","Type":"ContainerStarted","Data":"5146fa9514f4a7a33496499d30a9151b90551b5179906767b52f13df2924cf41"} Jul 27 16:24:43.632581 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:43.632096 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:43.632650 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:43.632601 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mgsgk" Jul 27 16:24:43.689976 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:43.689930 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" podStartSLOduration=7.4061160600000004 podStartE2EDuration="27.689915924s" totalImagesPullingTime="20.283799864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:43.670478047 +0000 UTC m=+28.703789653" watchObservedRunningTime="2026-07-27 16:24:43.689915924 +0000 UTC m=+28.723227530" Jul 27 16:24:44.454481 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.454448 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:44.454661 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.454494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:44.454661 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.454500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:44.454661 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:44.454578 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:44.454835 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:44.454683 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:44.454835 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:44.454778 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:44.635903 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.635873 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:44.636352 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.635962 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:44.636352 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.636016 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:44.650920 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.650896 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:44.651352 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:44.651326 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:24:45.322864 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.322838 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-56rvn"] Jul 27 16:24:45.323020 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.322977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:45.323097 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:45.323075 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:45.326416 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.326393 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9bkmb"] Jul 27 16:24:45.326522 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.326482 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:45.326578 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:45.326553 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:45.329137 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.329116 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j69dd"] Jul 27 16:24:45.329200 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.329193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:45.329330 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:45.329306 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:45.638511 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.638423 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="92ea8848c7fd4ecec8d5430b0ed55540f03ab4c46dca59f9f7e4287f6ffcbd19" exitCode=0 Jul 27 16:24:45.638885 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:45.638514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"92ea8848c7fd4ecec8d5430b0ed55540f03ab4c46dca59f9f7e4287f6ffcbd19"} Jul 27 16:24:46.642810 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:46.642709 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="cb615215efd565f1ca75e330b907d8f1771630c321e2d85f10f5e58b6bf737e7" exitCode=0 Jul 27 16:24:46.642810 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:46.642794 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"cb615215efd565f1ca75e330b907d8f1771630c321e2d85f10f5e58b6bf737e7"} Jul 27 16:24:47.454171 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:47.454144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:47.454310 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:47.454144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:47.454310 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:47.454271 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:47.454439 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:47.454144 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:47.454439 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:47.454326 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:47.454439 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:47.454419 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:48.648581 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:48.648541 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="9cd2924cf24f6fe0d598c21aee3061d7ed0a1ad6d7a49d910fc45dd77b0c728d" exitCode=0 Jul 27 16:24:48.648943 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:48.648603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"9cd2924cf24f6fe0d598c21aee3061d7ed0a1ad6d7a49d910fc45dd77b0c728d"} Jul 27 16:24:49.063303 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.063266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.063311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.063351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063397 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063447 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063476 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 16:24:49.063499 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063493 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 16:24:49.063721 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063506 2575 projected.go:196] Error preparing data for projected volume kube-api-access-6k6gw for pod openshift-network-diagnostics/network-check-target-9bkmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:49.063721 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063451 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:21.063438077 +0000 UTC m=+66.096749660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 16:24:49.063721 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063554 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret podName:f1d75743-e1f4-4ec8-ab87-c9217b57fbe1 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:21.063542653 +0000 UTC m=+66.096854236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret") pod "global-pull-secret-syncer-j69dd" (UID: "f1d75743-e1f4-4ec8-ab87-c9217b57fbe1") : object "kube-system"/"original-pull-secret" not registered Jul 27 16:24:49.063721 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.063568 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw podName:35b09e63-2204-4fd9-9ad3-9818b4524f55 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:21.063562912 +0000 UTC m=+66.096874496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6k6gw" (UniqueName: "kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw") pod "network-check-target-9bkmb" (UID: "35b09e63-2204-4fd9-9ad3-9818b4524f55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 16:24:49.454523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.454494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:49.454713 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.454494 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:49.454713 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.454624 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j69dd" podUID="f1d75743-e1f4-4ec8-ab87-c9217b57fbe1" Jul 27 16:24:49.454713 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:49.454643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:49.454858 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.454747 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:24:49.454858 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:49.454838 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9bkmb" podUID="35b09e63-2204-4fd9-9ad3-9818b4524f55" Jul 27 16:24:50.771659 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.771633 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-172.ec2.internal" event="NodeReady" Jul 27 16:24:50.772119 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.771784 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 16:24:50.819933 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.819904 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:24:50.857607 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.857582 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw"] Jul 27 16:24:50.857752 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.857707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.865758 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.865727 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 16:24:50.866267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.866065 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 16:24:50.866267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.866145 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 16:24:50.866461 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.866439 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kc6vj\"" Jul 27 16:24:50.867110 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.867088 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw"] Jul 27 16:24:50.867203 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.867138 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:24:50.867203 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.867160 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mx274"] Jul 27 16:24:50.867337 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.867248 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:50.871106 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.871083 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 16:24:50.872102 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.871303 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 16:24:50.872323 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.872301 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6dn5d\"" Jul 27 16:24:50.873870 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.873850 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 16:24:50.879758 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.879740 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mx274" Jul 27 16:24:50.882104 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.882086 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pc959\"" Jul 27 16:24:50.883291 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.883269 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rbr49"] Jul 27 16:24:50.883840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.883820 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 16:24:50.884819 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.884802 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 16:24:50.895513 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.895496 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mx274"] Jul 27 16:24:50.895596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.895575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:50.899191 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.899170 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 16:24:50.899383 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.899364 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 16:24:50.899489 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.899466 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 16:24:50.899727 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.899708 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rks8d\"" Jul 27 16:24:50.900180 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.900155 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbr49"] Jul 27 16:24:50.977549 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977598 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977613 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977676 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8edff5fd-1054-4406-9015-36f9e28f7382-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:50.977731 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/82db6950-00b0-484f-9f7b-d8b12cd439cc-kube-api-access-2zg4j\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxzn5\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977862 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82db6950-00b0-484f-9f7b-d8b12cd439cc-config-volume\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977901 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82db6950-00b0-484f-9f7b-d8b12cd439cc-tmp-dir\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:50.978034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:50.977956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.078949 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.078872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.078949 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.078909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.078949 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.078939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpxz\" (UniqueName: \"kubernetes.io/projected/55f68011-1582-411b-afa5-862e9ab575f8-kube-api-access-skpxz\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.078992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8edff5fd-1054-4406-9015-36f9e28f7382-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/82db6950-00b0-484f-9f7b-d8b12cd439cc-kube-api-access-2zg4j\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxzn5\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079138 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82db6950-00b0-484f-9f7b-d8b12cd439cc-config-volume\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.079282 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82db6950-00b0-484f-9f7b-d8b12cd439cc-tmp-dir\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f68011-1582-411b-afa5-862e9ab575f8-cert\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079607 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079730 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82db6950-00b0-484f-9f7b-d8b12cd439cc-tmp-dir\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.079959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.079959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.079815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8edff5fd-1054-4406-9015-36f9e28f7382-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:51.079959 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.079832 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:24:51.079959 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.079947 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:51.579926862 +0000 UTC m=+36.613238463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:24:51.080201 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.080083 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:24:51.080201 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.080167 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:24:51.580148369 +0000 UTC m=+36.613459969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:24:51.080201 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.080177 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:24:51.080201 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.080192 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:24:51.080349 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.080282 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:51.580264109 +0000 UTC m=+36.613575707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:24:51.080386 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.080363 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.080418 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.080407 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/82db6950-00b0-484f-9f7b-d8b12cd439cc-config-volume\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.083784 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.083680 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.083896 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.083705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.088579 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.088545 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.088689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.088619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxzn5\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.088689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.088632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/82db6950-00b0-484f-9f7b-d8b12cd439cc-kube-api-access-2zg4j\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.180676 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.180643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skpxz\" (UniqueName: \"kubernetes.io/projected/55f68011-1582-411b-afa5-862e9ab575f8-kube-api-access-skpxz\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.180872 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.180731 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f68011-1582-411b-afa5-862e9ab575f8-cert\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.183463 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.183429 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55f68011-1582-411b-afa5-862e9ab575f8-cert\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.190840 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.190814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpxz\" (UniqueName: \"kubernetes.io/projected/55f68011-1582-411b-afa5-862e9ab575f8-kube-api-access-skpxz\") pod \"ingress-canary-rbr49\" (UID: \"55f68011-1582-411b-afa5-862e9ab575f8\") " pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.206471 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.206445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbr49" Jul 27 16:24:51.454432 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.454399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:24:51.454646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.454399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:24:51.454646 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.454400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:24:51.456781 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.456758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8qptk\"" Jul 27 16:24:51.456897 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.456825 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 16:24:51.457170 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.457147 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:24:51.457513 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.457495 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrtwx\"" Jul 27 16:24:51.458044 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.458026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 16:24:51.458138 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.458029 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:24:51.463760 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.463735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:51.552773 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.552709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:51.584677 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.584643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:51.584824 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.584774 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:24:51.584824 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.584794 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:24:51.584931 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.584779 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:51.584931 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.584856 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:52.584836525 +0000 UTC m=+37.618148169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:24:51.584931 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.584871 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:24:51.584931 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.584919 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:52.584903775 +0000 UTC m=+37.618215376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:24:51.585140 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:51.584954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:51.585140 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.585032 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:24:51.585140 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:51.585073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:24:52.585059747 +0000 UTC m=+37.618371345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:24:52.593563 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:52.593527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:52.593590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:52.593617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593712 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593734 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593755 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593769 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593801 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:54.593780518 +0000 UTC m=+39.627092109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593816 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:24:54.593810105 +0000 UTC m=+39.627121689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:24:52.593985 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:52.593826 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:54.593821092 +0000 UTC m=+39.627132676 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:24:52.791504 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:52.791471 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbr49"] Jul 27 16:24:52.857164 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:24:52.857110 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f68011_1582_411b_afa5_862e9ab575f8.slice/crio-7db2ef429b5ec3f1b6f136f1f936f767bf48e1d15e7c34b33466f17dfcc81a51 WatchSource:0}: Error finding container 7db2ef429b5ec3f1b6f136f1f936f767bf48e1d15e7c34b33466f17dfcc81a51: Status 404 returned error can't find the container with id 7db2ef429b5ec3f1b6f136f1f936f767bf48e1d15e7c34b33466f17dfcc81a51 Jul 27 16:24:53.662825 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:53.662794 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="820fc414a6ba35f489cf47ddac803e97e273d46fec65600b7f022a99ff37c0e0" exitCode=0 Jul 27 16:24:53.663666 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:53.662879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"820fc414a6ba35f489cf47ddac803e97e273d46fec65600b7f022a99ff37c0e0"} Jul 27 16:24:53.664026 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:53.663931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbr49" event={"ID":"55f68011-1582-411b-afa5-862e9ab575f8","Type":"ContainerStarted","Data":"7db2ef429b5ec3f1b6f136f1f936f767bf48e1d15e7c34b33466f17dfcc81a51"} Jul 27 16:24:54.362590 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.362553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:54.609598 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.609565 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:54.609777 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.609617 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:54.609777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609704 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:24:54.609777 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.609739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:54.609777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609753 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.60974098 +0000 UTC m=+43.643052563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:24:54.609777 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609705 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:24:54.609983 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609828 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.609814151 +0000 UTC m=+43.643125754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:24:54.609983 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609855 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:24:54.609983 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609870 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:24:54.609983 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:54.609906 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:24:58.609895638 +0000 UTC m=+43.643207244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:24:54.668939 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.668871 2575 generic.go:356] "Generic (PLEG): container finished" podID="195be682-e8bc-4574-8db4-e87bcd9436f5" containerID="a042a21ddeacfd865f89e141745f12b0f71247203c570d3609c6e38d83d9f7ec" exitCode=0 Jul 27 16:24:54.668939 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:54.668908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerDied","Data":"a042a21ddeacfd865f89e141745f12b0f71247203c570d3609c6e38d83d9f7ec"} Jul 27 16:24:55.675493 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:55.675459 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" event={"ID":"195be682-e8bc-4574-8db4-e87bcd9436f5","Type":"ContainerStarted","Data":"6fb4ca231253f3b9fd6d2123c8aa1bf81cbb7b483090f8aec6936241a53e6ae1"} Jul 27 16:24:55.679303 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:55.679248 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:55.717755 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:55.717705 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hwmt6" podStartSLOduration=7.323881154 podStartE2EDuration="39.717691572s" totalImagesPullingTime="32.393810418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:55.714275275 +0000 UTC m=+40.747586881" watchObservedRunningTime="2026-07-27 16:24:55.717691572 +0000 UTC m=+40.751003177" Jul 27 16:24:55.771800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:55.771763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:55.905420 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:55.905386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:56.038057 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:56.038025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:24:57.684248 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:57.684201 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbr49" event={"ID":"55f68011-1582-411b-afa5-862e9ab575f8","Type":"ContainerStarted","Data":"c72c5d3975c24bef2ef42e94ffbc7b6675c21b5a4a0593da975a277718a9f32e"} Jul 27 16:24:57.707426 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:57.707371 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rbr49" podStartSLOduration=3.928088777 podStartE2EDuration="7.707353191s" totalImagesPullingTime="3.779264414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:57.706990311 +0000 UTC m=+42.740301919" watchObservedRunningTime="2026-07-27 16:24:57.707353191 +0000 UTC m=+42.740664798" Jul 27 16:24:58.641395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:58.641361 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:24:58.641551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:58.641509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:24:58.641551 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641528 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:24:58.641551 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:24:58.641547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:24:58.641648 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641549 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:24:58.641648 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641589 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:24:58.641648 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641619 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:25:06.641605995 +0000 UTC m=+51.674917578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:24:58.641744 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:06.64162686 +0000 UTC m=+51.674938444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:24:58.641744 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641671 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:24:58.641744 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:24:58.641724 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:25:06.64171003 +0000 UTC m=+51.675021617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:25:03.753631 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:03.753596 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:04.237649 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:04.237621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:05.097721 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:05.097689 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:05.198357 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:05.198326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:06.510446 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.510413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:06.632433 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.632403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:06.695433 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.695408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:25:06.695550 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.695449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:25:06.695550 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.695470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695574 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695578 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695596 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695608 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:25:22.695619553 +0000 UTC m=+67.728931152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:22.695646507 +0000 UTC m=+67.728958092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:25:06.695719 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:06.695663 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:25:22.695658652 +0000 UTC m=+67.728970236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:25:06.734125 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:06.734102 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:14.438368 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.438327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:14.808320 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.808239 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd"] Jul 27 16:25:14.812354 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.812336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.814634 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.814615 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 16:25:14.815580 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.815550 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 16:25:14.815816 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.815613 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qklv2\"" Jul 27 16:25:14.823410 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.823393 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 16:25:14.824002 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.823982 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 16:25:14.851520 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.851499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a12d570-6ac6-436b-9364-91aaac93ea0d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.851616 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.851525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlg9g\" (UniqueName: \"kubernetes.io/projected/5a12d570-6ac6-436b-9364-91aaac93ea0d-kube-api-access-hlg9g\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.889281 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.889253 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd"] Jul 27 16:25:14.952714 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.952680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a12d570-6ac6-436b-9364-91aaac93ea0d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.952714 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.952719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlg9g\" (UniqueName: \"kubernetes.io/projected/5a12d570-6ac6-436b-9364-91aaac93ea0d-kube-api-access-hlg9g\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.956587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.956560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a12d570-6ac6-436b-9364-91aaac93ea0d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:14.964030 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:14.964009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlg9g\" (UniqueName: \"kubernetes.io/projected/5a12d570-6ac6-436b-9364-91aaac93ea0d-kube-api-access-hlg9g\") pod \"managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd\" (UID: \"5a12d570-6ac6-436b-9364-91aaac93ea0d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:15.134450 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:15.134392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:25:15.279236 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:15.279187 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd"] Jul 27 16:25:15.283813 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:25:15.283791 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a12d570_6ac6_436b_9364_91aaac93ea0d.slice/crio-7d20caf506fceb4d147445e55fbf9eefec11c195fe72277e06a87b7909d5ba30 WatchSource:0}: Error finding container 7d20caf506fceb4d147445e55fbf9eefec11c195fe72277e06a87b7909d5ba30: Status 404 returned error can't find the container with id 7d20caf506fceb4d147445e55fbf9eefec11c195fe72277e06a87b7909d5ba30 Jul 27 16:25:15.725783 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:15.725750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerStarted","Data":"7d20caf506fceb4d147445e55fbf9eefec11c195fe72277e06a87b7909d5ba30"} Jul 27 16:25:16.661505 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:16.661479 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knsrr" Jul 27 16:25:16.926323 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:16.926256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:17.033235 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:17.033195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:20.739673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:20.739635 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerStarted","Data":"b2302e5abd30faf1fb8d4d42ecba16bc7f8efe1473dbf872f648e858899c1f69"} Jul 27 16:25:20.761902 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:20.761850 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" podStartSLOduration=1.433115807 podStartE2EDuration="6.761834075s" totalImagesPullingTime="5.328718268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:20.761783671 +0000 UTC m=+65.795095277" watchObservedRunningTime="2026-07-27 16:25:20.761834075 +0000 UTC m=+65.795145681" Jul 27 16:25:21.097202 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.097164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:25:21.097382 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.097236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:25:21.097382 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.097284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:25:21.100495 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.100476 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 16:25:21.100547 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.100514 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 16:25:21.100598 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.100582 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 16:25:21.107509 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:21.107490 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 16:25:21.107592 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:21.107560 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:26:25.107540748 +0000 UTC m=+130.140852349 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : secret "metrics-daemon-secret" not found Jul 27 16:25:21.109553 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.109534 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 16:25:21.109759 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.109742 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f1d75743-e1f4-4ec8-ab87-c9217b57fbe1-original-pull-secret\") pod \"global-pull-secret-syncer-j69dd\" (UID: \"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1\") " pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:25:21.120483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.120464 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6gw\" (UniqueName: \"kubernetes.io/projected/35b09e63-2204-4fd9-9ad3-9818b4524f55-kube-api-access-6k6gw\") pod \"network-check-target-9bkmb\" (UID: \"35b09e63-2204-4fd9-9ad3-9818b4524f55\") " pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:25:21.175573 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.175556 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8qptk\"" Jul 27 16:25:21.178666 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.178653 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j69dd" Jul 27 16:25:21.184684 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.184667 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:25:21.308570 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.308538 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j69dd"] Jul 27 16:25:21.311740 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:25:21.311711 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d75743_e1f4_4ec8_ab87_c9217b57fbe1.slice/crio-75fb1cde91bfd5caa71578d48e22e745deaef1393e20a2457f5f66a385820f21 WatchSource:0}: Error finding container 75fb1cde91bfd5caa71578d48e22e745deaef1393e20a2457f5f66a385820f21: Status 404 returned error can't find the container with id 75fb1cde91bfd5caa71578d48e22e745deaef1393e20a2457f5f66a385820f21 Jul 27 16:25:21.333521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.333498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9bkmb"] Jul 27 16:25:21.336662 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:25:21.336638 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b09e63_2204_4fd9_9ad3_9818b4524f55.slice/crio-51eca0fe01fd9037c7f745727d799dc4ae4ddef5ae377983d52f7e8e9c62e09c WatchSource:0}: Error finding container 51eca0fe01fd9037c7f745727d799dc4ae4ddef5ae377983d52f7e8e9c62e09c: Status 404 returned error can't find the container with id 51eca0fe01fd9037c7f745727d799dc4ae4ddef5ae377983d52f7e8e9c62e09c Jul 27 16:25:21.742695 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.742661 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j69dd" event={"ID":"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1","Type":"ContainerStarted","Data":"75fb1cde91bfd5caa71578d48e22e745deaef1393e20a2457f5f66a385820f21"} Jul 27 16:25:21.743733 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:21.743710 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9bkmb" event={"ID":"35b09e63-2204-4fd9-9ad3-9818b4524f55","Type":"ContainerStarted","Data":"51eca0fe01fd9037c7f745727d799dc4ae4ddef5ae377983d52f7e8e9c62e09c"} Jul 27 16:25:22.711370 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:22.711330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:25:22.711565 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:22.711387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:25:22.711565 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:22.711414 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:25:22.711565 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711530 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:22.711565 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711543 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:25:22.711765 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711604 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:25:54.711585836 +0000 UTC m=+99.744897421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:25:22.711765 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711716 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:25:22.711870 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711775 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:22.711870 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711787 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:25:54.711767853 +0000 UTC m=+99.745079452 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:25:22.711870 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:22.711829 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:25:54.711813819 +0000 UTC m=+99.745125417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:25:24.752787 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:24.752747 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9bkmb" event={"ID":"35b09e63-2204-4fd9-9ad3-9818b4524f55","Type":"ContainerStarted","Data":"d01c5a96813c754ac870e305774dd9b5325186b9267e6ff392673bf243941644"} Jul 27 16:25:24.753257 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:24.752895 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:25:24.773748 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:24.773705 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9bkmb" podStartSLOduration=65.889745318 podStartE2EDuration="1m8.773692904s" totalImagesPullingTime="2.883947586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:24.771736357 +0000 UTC m=+69.805047963" watchObservedRunningTime="2026-07-27 16:25:24.773692904 +0000 UTC m=+69.807004535" Jul 27 16:25:25.823680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:25.823635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:25.931806 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:25.931771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:26.758754 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:26.758721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j69dd" event={"ID":"f1d75743-e1f4-4ec8-ab87-c9217b57fbe1","Type":"ContainerStarted","Data":"a67b39a3b08731af5eaa668f1636331f0616a033b1a320fb71f595250c2ed47f"} Jul 27 16:25:26.779913 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:26.779867 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j69dd" podStartSLOduration=65.690035445 podStartE2EDuration="1m10.779853144s" totalImagesPullingTime="5.089817699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:25:26.778902729 +0000 UTC m=+71.812214347" watchObservedRunningTime="2026-07-27 16:25:26.779853144 +0000 UTC m=+71.813164749" Jul 27 16:25:28.471420 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:28.471386 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:28.570294 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:28.570262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:28.672566 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:28.672538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:31.124192 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:31.124156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:31.225835 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:31.225807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:25:54.738389 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:54.738349 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:54.738401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:54.738423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738532 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738551 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738562 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738532 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738616 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:26:58.738601022 +0000 UTC m=+163.771912628 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738637 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:26:58.738627911 +0000 UTC m=+163.771939500 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:25:54.738711 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:25:54.738651 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:26:58.738643617 +0000 UTC m=+163.771955204 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:25:55.758014 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:25:55.757982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9bkmb" Jul 27 16:26:02.525988 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:02.525954 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:26:02.610806 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:02.610782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:26:25.136672 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:25.136640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:26:25.137072 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:25.136770 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 16:26:25.137072 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:25.136842 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:27.136826951 +0000 UTC m=+252.170138535 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : secret "metrics-daemon-secret" not found Jul 27 16:26:53.870697 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:53.870653 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" Jul 27 16:26:53.879816 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:53.879788 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" podUID="8edff5fd-1054-4406-9015-36f9e28f7382" Jul 27 16:26:53.889939 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:53.889908 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mx274" podUID="82db6950-00b0-484f-9f7b-d8b12cd439cc" Jul 27 16:26:53.966979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:53.966953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mx274" Jul 27 16:26:53.967080 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:53.966956 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:26:54.467111 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:54.467060 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:26:58.769953 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:58.769913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:26:58.769953 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:58.769960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:26:58.769979 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770055 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770090 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770102 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cd8f8fc74-5wfkd: secret "image-registry-tls" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770118 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls podName:82db6950-00b0-484f-9f7b-d8b12cd439cc nodeName:}" failed. No retries permitted until 2026-07-27 16:29:00.770103362 +0000 UTC m=+285.803414947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls") pod "dns-default-mx274" (UID: "82db6950-00b0-484f-9f7b-d8b12cd439cc") : secret "dns-default-metrics-tls" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770141 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls podName:4dcd4bc7-2a27-421b-9a15-559958eb9e3d nodeName:}" failed. No retries permitted until 2026-07-27 16:29:00.77012729 +0000 UTC m=+285.803438875 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls") pod "image-registry-7cd8f8fc74-5wfkd" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d") : secret "image-registry-tls" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770055 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 16:26:58.770397 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:26:58.770199 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert podName:8edff5fd-1054-4406-9015-36f9e28f7382 nodeName:}" failed. No retries permitted until 2026-07-27 16:29:00.770188922 +0000 UTC m=+285.803500511 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-s9vbw" (UID: "8edff5fd-1054-4406-9015-36f9e28f7382") : secret "networking-console-plugin-cert" not found Jul 27 16:27:04.454158 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:04.454122 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:27:05.455570 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:05.455534 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:27:21.032183 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:21.032097 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a12d570-6ac6-436b-9364-91aaac93ea0d" containerID="b2302e5abd30faf1fb8d4d42ecba16bc7f8efe1473dbf872f648e858899c1f69" exitCode=255 Jul 27 16:27:21.032183 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:21.032156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerDied","Data":"b2302e5abd30faf1fb8d4d42ecba16bc7f8efe1473dbf872f648e858899c1f69"} Jul 27 16:27:21.037448 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:21.037430 2575 scope.go:117] "RemoveContainer" containerID="b2302e5abd30faf1fb8d4d42ecba16bc7f8efe1473dbf872f648e858899c1f69" Jul 27 16:27:22.036397 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:22.036364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerStarted","Data":"bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4"} Jul 27 16:27:44.889788 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:27:44.889757 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:16.723274 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.723241 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz"] Jul 27 16:28:16.725108 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.725091 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.727852 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.727828 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 16:28:16.727947 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.727902 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 16:28:16.727947 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.727914 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lgh85\"" Jul 27 16:28:16.728375 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.728361 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.728735 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.728716 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.729682 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.729661 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj"] Jul 27 16:28:16.731457 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.731438 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh"] Jul 27 16:28:16.731593 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.731575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" Jul 27 16:28:16.733247 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.733214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m747b\"" Jul 27 16:28:16.733343 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.733269 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.733918 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.733900 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.734355 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.734338 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cbfd4d8d9-sqnwx"] Jul 27 16:28:16.734452 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.734438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.736048 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.736024 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.736126 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.736089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.736472 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.736449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 27 16:28:16.737392 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.737373 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.737487 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.737379 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 27 16:28:16.737487 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.737412 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-brhxh\"" Jul 27 16:28:16.737626 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.737599 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz"] Jul 27 16:28:16.739521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.739502 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-f9wkr\"" Jul 27 16:28:16.739689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.739668 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 16:28:16.740403 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.740382 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 16:28:16.740501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.740457 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 16:28:16.740501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.740473 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 16:28:16.740501 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.740481 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 16:28:16.740663 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.740583 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 16:28:16.749710 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.749691 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj"] Jul 27 16:28:16.753361 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.753337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbfd4d8d9-sqnwx"] Jul 27 16:28:16.754334 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.754314 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh"] Jul 27 16:28:16.798262 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-stats-auth\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.798262 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798262 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.798467 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/28ecb5fb-29b9-404b-811c-09c6122d80cf-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.798467 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-default-certificate\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.798467 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/921f1436-e1f0-499e-b580-02b6a6b07916-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.798467 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.798610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/921f1436-e1f0-499e-b580-02b6a6b07916-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.798610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798499 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.798610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxgd\" (UniqueName: \"kubernetes.io/projected/921f1436-e1f0-499e-b580-02b6a6b07916-kube-api-access-qwxgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.798610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798545 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm949\" (UniqueName: \"kubernetes.io/projected/28ecb5fb-29b9-404b-811c-09c6122d80cf-kube-api-access-hm949\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.798610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74g7v\" (UniqueName: \"kubernetes.io/projected/9722f74d-73ef-4f1e-8bd7-ff2e695e09d3-kube-api-access-74g7v\") pod \"volume-data-source-validator-549c6d54cf-fg8zj\" (UID: \"9722f74d-73ef-4f1e-8bd7-ff2e695e09d3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" Jul 27 16:28:16.798855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.798662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5nw4\" (UniqueName: \"kubernetes.io/projected/1805f4e9-6308-47e7-b140-8e31fabd07b5-kube-api-access-g5nw4\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899458 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/921f1436-e1f0-499e-b580-02b6a6b07916-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.899458 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899649 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxgd\" (UniqueName: \"kubernetes.io/projected/921f1436-e1f0-499e-b580-02b6a6b07916-kube-api-access-qwxgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.899649 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm949\" (UniqueName: \"kubernetes.io/projected/28ecb5fb-29b9-404b-811c-09c6122d80cf-kube-api-access-hm949\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.899649 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:16.899614 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:17.399590738 +0000 UTC m=+242.432902326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74g7v\" (UniqueName: \"kubernetes.io/projected/9722f74d-73ef-4f1e-8bd7-ff2e695e09d3-kube-api-access-74g7v\") pod \"volume-data-source-validator-549c6d54cf-fg8zj\" (UID: \"9722f74d-73ef-4f1e-8bd7-ff2e695e09d3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5nw4\" (UniqueName: \"kubernetes.io/projected/1805f4e9-6308-47e7-b140-8e31fabd07b5-kube-api-access-g5nw4\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899718 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-stats-auth\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/28ecb5fb-29b9-404b-811c-09c6122d80cf-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-default-certificate\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.899859 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:16.899853 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:28:16.900250 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:16.899910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:17.399892997 +0000 UTC m=+242.433204584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : secret "router-metrics-certs-default" not found Jul 27 16:28:16.900250 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/921f1436-e1f0-499e-b580-02b6a6b07916-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.900250 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.899970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.900250 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:16.900068 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:16.900250 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:16.900115 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:17.400101716 +0000 UTC m=+242.433413300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:16.900604 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.900578 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/28ecb5fb-29b9-404b-811c-09c6122d80cf-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.900669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.900621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/921f1436-e1f0-499e-b580-02b6a6b07916-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.901902 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.901870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/921f1436-e1f0-499e-b580-02b6a6b07916-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.902090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.902072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-default-certificate\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.902185 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.902167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-stats-auth\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.910413 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.910389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5nw4\" (UniqueName: \"kubernetes.io/projected/1805f4e9-6308-47e7-b140-8e31fabd07b5-kube-api-access-g5nw4\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:16.910503 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.910420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm949\" (UniqueName: \"kubernetes.io/projected/28ecb5fb-29b9-404b-811c-09c6122d80cf-kube-api-access-hm949\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:16.910796 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.910779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxgd\" (UniqueName: \"kubernetes.io/projected/921f1436-e1f0-499e-b580-02b6a6b07916-kube-api-access-qwxgd\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz\" (UID: \"921f1436-e1f0-499e-b580-02b6a6b07916\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:16.911065 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.911047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74g7v\" (UniqueName: \"kubernetes.io/projected/9722f74d-73ef-4f1e-8bd7-ff2e695e09d3-kube-api-access-74g7v\") pod \"volume-data-source-validator-549c6d54cf-fg8zj\" (UID: \"9722f74d-73ef-4f1e-8bd7-ff2e695e09d3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" Jul 27 16:28:16.934641 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:16.934614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:17.034884 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.034827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" Jul 27 16:28:17.040563 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.040541 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:17.043417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.043401 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" Jul 27 16:28:17.164658 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.164638 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz"] Jul 27 16:28:17.166884 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:17.166855 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921f1436_e1f0_499e_b580_02b6a6b07916.slice/crio-82d1ef0af5b1c0ed8e4af4ccec95d1fffdbf4765aab0cea6c565156106ebaf73 WatchSource:0}: Error finding container 82d1ef0af5b1c0ed8e4af4ccec95d1fffdbf4765aab0cea6c565156106ebaf73: Status 404 returned error can't find the container with id 82d1ef0af5b1c0ed8e4af4ccec95d1fffdbf4765aab0cea6c565156106ebaf73 Jul 27 16:28:17.194813 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.194784 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj"] Jul 27 16:28:17.195258 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:17.195235 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9722f74d_73ef_4f1e_8bd7_ff2e695e09d3.slice/crio-4693e40634e0588851e2eb3a52bf166ae5d1a602cdda52702894893652ec1ba1 WatchSource:0}: Error finding container 4693e40634e0588851e2eb3a52bf166ae5d1a602cdda52702894893652ec1ba1: Status 404 returned error can't find the container with id 4693e40634e0588851e2eb3a52bf166ae5d1a602cdda52702894893652ec1ba1 Jul 27 16:28:17.405523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.405452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:17.405523 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.405502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:17.405685 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:17.405568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:17.405685 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:17.405608 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:28:17.405685 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:17.405677 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:18.405660064 +0000 UTC m=+243.438971649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:17.405783 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:17.405694 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:18.40568553 +0000 UTC m=+243.438997115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : secret "router-metrics-certs-default" not found Jul 27 16:28:17.405783 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:17.405673 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:17.405783 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:17.405724 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:18.405716762 +0000 UTC m=+243.439028347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:18.168872 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:18.168793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" event={"ID":"921f1436-e1f0-499e-b580-02b6a6b07916","Type":"ContainerStarted","Data":"82d1ef0af5b1c0ed8e4af4ccec95d1fffdbf4765aab0cea6c565156106ebaf73"} Jul 27 16:28:18.170181 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:18.170146 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" event={"ID":"9722f74d-73ef-4f1e-8bd7-ff2e695e09d3","Type":"ContainerStarted","Data":"4693e40634e0588851e2eb3a52bf166ae5d1a602cdda52702894893652ec1ba1"} Jul 27 16:28:18.414453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:18.414417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:18.414597 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:18.414571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:18.414663 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:18.414598 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:20.414575854 +0000 UTC m=+245.447887462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:18.414729 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:18.414660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:18.414729 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:18.414676 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:28:18.414795 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:18.414737 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:20.414722283 +0000 UTC m=+245.448033884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : secret "router-metrics-certs-default" not found Jul 27 16:28:18.414795 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:18.414762 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:18.414795 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:18.414792 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:20.414783838 +0000 UTC m=+245.448095422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:19.174847 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:19.174806 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" event={"ID":"9722f74d-73ef-4f1e-8bd7-ff2e695e09d3","Type":"ContainerStarted","Data":"e579bf90c361324d7bf9baf886b115cb99885ecaaa5d17759a29dd5c0e462635"} Jul 27 16:28:19.191872 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:19.191816 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-fg8zj" podStartSLOduration=1.952621137 podStartE2EDuration="3.191787316s" totalImagesPullingTime="1.239166179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:19.191738106 +0000 UTC m=+244.225049713" watchObservedRunningTime="2026-07-27 16:28:19.191787316 +0000 UTC m=+244.225098926" Jul 27 16:28:19.292074 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:19.292030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:20.179379 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.179342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" event={"ID":"921f1436-e1f0-499e-b580-02b6a6b07916","Type":"ContainerStarted","Data":"ed1c5f857edfa38fbc405710158ae8e8fb8b2ce3750b4c97fdeaf43bb4cdd5b6"} Jul 27 16:28:20.196941 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.196893 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" podStartSLOduration=1.789859312 podStartE2EDuration="4.196878872s" totalImagesPullingTime="2.40701956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:20.195356217 +0000 UTC m=+245.228667823" watchObservedRunningTime="2026-07-27 16:28:20.196878872 +0000 UTC m=+245.230190506" Jul 27 16:28:20.433696 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.433621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:20.433696 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.433672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:20.433866 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:20.433763 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:20.433866 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.433770 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:20.433866 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:20.433809 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.433796159 +0000 UTC m=+249.467107756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:20.433965 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:20.433881 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:28:20.433965 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:20.433887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.433875248 +0000 UTC m=+249.467186858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:20.433965 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:20.433937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.433924759 +0000 UTC m=+249.467236345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : secret "router-metrics-certs-default" not found Jul 27 16:28:20.938734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.938701 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vhvk6"] Jul 27 16:28:20.941077 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.941056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:20.943061 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.943035 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 16:28:20.943158 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.943082 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 16:28:20.943468 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.943448 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 16:28:20.943468 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.943461 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 16:28:20.943602 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.943454 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x8wvw\"" Jul 27 16:28:20.954384 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:20.954360 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vhvk6"] Jul 27 16:28:21.038337 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.038310 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmc6\" (UniqueName: \"kubernetes.io/projected/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-api-access-nsmc6\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.038454 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.038358 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.038454 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.038433 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-data-volume\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.038543 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.038488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-crio-socket\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.038587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.038565 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.139902 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.139865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmc6\" (UniqueName: \"kubernetes.io/projected/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-api-access-nsmc6\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140028 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.139913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140028 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.139952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-data-volume\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140028 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.139990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-crio-socket\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140137 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.140054 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140137 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.140098 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.140137 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.140121 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:21.140244 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.140159 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:21.64014188 +0000 UTC m=+246.673453478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.140244 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.140172 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:21.640166502 +0000 UTC m=+246.673478085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : configmap "kube-rbac-proxy" not found Jul 27 16:28:21.140244 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.140165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-crio-socket\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.140353 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.140342 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-data-volume\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.148851 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.148828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsmc6\" (UniqueName: \"kubernetes.io/projected/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-api-access-nsmc6\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.643061 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.643025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.643454 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:21.643137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:21.643454 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.643162 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.643454 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.643211 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:21.643454 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.643217 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:22.643202892 +0000 UTC m=+247.676514490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:21.643454 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:21.643286 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:22.643269614 +0000 UTC m=+247.676581219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : configmap "kube-rbac-proxy" not found Jul 27 16:28:22.194350 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.194317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:22.266201 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.266173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:22.649742 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.649663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:22.649742 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.649720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:22.650121 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:22.649789 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:22.650121 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:22.649808 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:22.650121 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:22.649860 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.649847029 +0000 UTC m=+249.683158626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:22.650121 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:22.649872 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:24.649865464 +0000 UTC m=+249.683177048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : configmap "kube-rbac-proxy" not found Jul 27 16:28:22.807821 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.807784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:22.887484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.887456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:22.927922 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:22.927866 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lptsj_b0d5637d-0f66-47f6-bc31-67c73cd78b4c/dns-node-resolver/0.log" Jul 27 16:28:23.514704 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:23.514669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:23.614486 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:23.614456 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:24.127941 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.127913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfwbd_eccc9870-4298-46a4-b6dd-240a2f583e46/node-ca/0.log" Jul 27 16:28:24.465786 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.465752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:24.465965 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.465845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:24.465965 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.465891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:24.465965 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.465902 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:32.465885994 +0000 UTC m=+257.499197578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:24.466118 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.465977 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 16:28:24.466118 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.466023 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:32.466010945 +0000 UTC m=+257.499322528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : secret "router-metrics-certs-default" not found Jul 27 16:28:24.466118 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.465977 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:24.466118 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.466053 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:32.466046472 +0000 UTC m=+257.499358056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:24.666994 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.666964 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:24.667127 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.667016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:24.667127 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.667076 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:24.667127 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.667113 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:24.667279 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.667139 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:28.66712494 +0000 UTC m=+253.700436524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : configmap "kube-rbac-proxy" not found Jul 27 16:28:24.667279 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:24.667153 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:28.66714629 +0000 UTC m=+253.700457874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:24.928444 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:24.928420 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbr49_55f68011-1582-411b-afa5-862e9ab575f8/serve-healthcheck-canary/0.log" Jul 27 16:28:25.179423 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:25.179349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:25.274355 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:25.274323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:26.508815 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:26.508782 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:27.187298 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:27.187268 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:28:27.187454 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:27.187405 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 16:28:27.187503 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:27.187470 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs podName:57d428b4-7cd5-45ce-b0d5-e84f2fa56d23 nodeName:}" failed. No retries permitted until 2026-07-27 16:30:29.187456668 +0000 UTC m=+374.220768255 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs") pod "network-metrics-daemon-56rvn" (UID: "57d428b4-7cd5-45ce-b0d5-e84f2fa56d23") : secret "metrics-daemon-secret" not found Jul 27 16:28:27.555019 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:27.554941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:27.756316 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:27.756280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:27.863639 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:27.863562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:27.992047 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:27.992018 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:28.111686 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:28.111657 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:28.263193 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:28.263161 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:28.699531 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:28.699500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:28.699923 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:28.699566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:28.699923 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:28.699618 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 16:28:28.699923 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:28.699686 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:36.699669657 +0000 UTC m=+261.732981241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : configmap "kube-rbac-proxy" not found Jul 27 16:28:28.699923 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:28.699708 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:28.699923 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:28.699758 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:36.699745694 +0000 UTC m=+261.733057278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:29.271101 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:29.271066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:29.453381 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:29.453354 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:29.783778 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:29.783743 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:29.883941 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:29.883915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:30.056029 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:30.055961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:30.249970 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:30.249935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:31.274409 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:31.274378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:31.672057 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:31.671980 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:31.917289 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:31.917261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:32.016456 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.016429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:32.098184 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.098159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:32.255719 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.255691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:32.529150 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.529115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:32.529549 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.529164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:32.529549 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.529232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:32.529549 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:32.529318 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:32.529549 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:32.529379 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls podName:28ecb5fb-29b9-404b-811c-09c6122d80cf nodeName:}" failed. No retries permitted until 2026-07-27 16:28:48.529364952 +0000 UTC m=+273.562676537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-w8rqh" (UID: "28ecb5fb-29b9-404b-811c-09c6122d80cf") : secret "cluster-monitoring-operator-tls" not found Jul 27 16:28:32.529549 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:32.529394 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle podName:1805f4e9-6308-47e7-b140-8e31fabd07b5 nodeName:}" failed. No retries permitted until 2026-07-27 16:28:48.529388257 +0000 UTC m=+273.562699841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle") pod "router-default-7cbfd4d8d9-sqnwx" (UID: "1805f4e9-6308-47e7-b140-8e31fabd07b5") : configmap references non-existent config key: service-ca.crt Jul 27 16:28:32.531483 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:32.531460 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1805f4e9-6308-47e7-b140-8e31fabd07b5-metrics-certs\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:33.464785 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:33.464755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:33.655544 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:33.655514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:33.756648 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:33.756576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:33.861061 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:33.861031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:34.163277 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:34.163181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:34.287588 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:34.287561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:34.366965 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:34.366941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:35.438855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:35.438814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:35.671329 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:35.671295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:35.860865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:35.860783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:36.062575 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.062542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:36.254419 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.254384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:36.649946 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.649868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:36.751528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.751496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:36.766768 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.766745 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:36.766846 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.766789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:36.766892 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:36.766880 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 16:28:36.766948 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:36.766940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls podName:749bcdf9-8c7b-44ab-a96c-a3a46a2164bc nodeName:}" failed. No retries permitted until 2026-07-27 16:28:52.766926569 +0000 UTC m=+277.800238153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vhvk6" (UID: "749bcdf9-8c7b-44ab-a96c-a3a46a2164bc") : secret "insights-runtime-extractor-tls" not found Jul 27 16:28:36.767215 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:36.767199 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:37.267654 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:37.267621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:37.781256 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:37.781213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:37.865242 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:37.865201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:37.929619 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:37.929591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:38.053202 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:38.053135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:38.252106 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:38.252077 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:39.430406 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:39.430373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:39.546157 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:39.546126 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:39.726307 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:39.726211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:39.896051 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:39.896022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:39.973204 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:39.973175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:40.095075 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:40.095009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:40.196034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:40.196007 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:40.619632 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:40.619599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:40.692683 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:40.692646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:41.136168 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:41.136140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:41.238562 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:41.238531 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:41.357617 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:41.357592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:42.139545 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:42.139510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:42.224098 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:42.224064 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:48.560693 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.560655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:48.561152 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.560737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:48.561262 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.561210 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1805f4e9-6308-47e7-b140-8e31fabd07b5-service-ca-bundle\") pod \"router-default-7cbfd4d8d9-sqnwx\" (UID: \"1805f4e9-6308-47e7-b140-8e31fabd07b5\") " pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:48.563136 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.563109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/28ecb5fb-29b9-404b-811c-09c6122d80cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-w8rqh\" (UID: \"28ecb5fb-29b9-404b-811c-09c6122d80cf\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:48.715301 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.715264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:48.809811 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.809773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:48.848256 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.848190 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" Jul 27 16:28:48.855173 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.855155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:48.982715 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:48.982685 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh"] Jul 27 16:28:48.985937 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:48.985908 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ecb5fb_29b9_404b_811c_09c6122d80cf.slice/crio-43759d3ff9db06316f0464490fa62742ec00b9cf06f06adf397ec84f0cbf6b18 WatchSource:0}: Error finding container 43759d3ff9db06316f0464490fa62742ec00b9cf06f06adf397ec84f0cbf6b18: Status 404 returned error can't find the container with id 43759d3ff9db06316f0464490fa62742ec00b9cf06f06adf397ec84f0cbf6b18 Jul 27 16:28:49.004582 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.004539 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cbfd4d8d9-sqnwx"] Jul 27 16:28:49.006292 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:49.006262 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1805f4e9_6308_47e7_b140_8e31fabd07b5.slice/crio-b6b8d265418d52f5e1396537c43ca1a8c3297a220ce67193c3fdce2c41152dbc WatchSource:0}: Error finding container b6b8d265418d52f5e1396537c43ca1a8c3297a220ce67193c3fdce2c41152dbc: Status 404 returned error can't find the container with id b6b8d265418d52f5e1396537c43ca1a8c3297a220ce67193c3fdce2c41152dbc Jul 27 16:28:49.147059 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.146940 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:49.260748 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.260713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" event={"ID":"1805f4e9-6308-47e7-b140-8e31fabd07b5","Type":"ContainerStarted","Data":"41bee1f41ef231bfeb571783f8ad56420d1ea997bec7cedc0ebe44b357d380f6"} Jul 27 16:28:49.260919 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.260801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" event={"ID":"1805f4e9-6308-47e7-b140-8e31fabd07b5","Type":"ContainerStarted","Data":"b6b8d265418d52f5e1396537c43ca1a8c3297a220ce67193c3fdce2c41152dbc"} Jul 27 16:28:49.261884 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.261853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" event={"ID":"28ecb5fb-29b9-404b-811c-09c6122d80cf","Type":"ContainerStarted","Data":"43759d3ff9db06316f0464490fa62742ec00b9cf06f06adf397ec84f0cbf6b18"} Jul 27 16:28:49.278570 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.278540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:49.855804 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.855767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:49.858124 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.858104 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:49.892040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:49.891992 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" podStartSLOduration=33.891976663 podStartE2EDuration="33.891976663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:49.300050989 +0000 UTC m=+274.333362595" watchObservedRunningTime="2026-07-27 16:28:49.891976663 +0000 UTC m=+274.925288267" Jul 27 16:28:50.265385 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:50.265344 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:50.266585 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:50.266563 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cbfd4d8d9-sqnwx" Jul 27 16:28:52.796192 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:52.796154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:52.798885 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:52.798851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/749bcdf9-8c7b-44ab-a96c-a3a46a2164bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vhvk6\" (UID: \"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc\") " pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:53.050324 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:53.050246 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vhvk6" Jul 27 16:28:53.187251 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:53.187197 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vhvk6"] Jul 27 16:28:53.554043 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:53.554006 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749bcdf9_8c7b_44ab_a96c_a3a46a2164bc.slice/crio-2568829e5483b879a1fbb05d446f67d5688b90574b0973d24135b69b9e10ad77 WatchSource:0}: Error finding container 2568829e5483b879a1fbb05d446f67d5688b90574b0973d24135b69b9e10ad77: Status 404 returned error can't find the container with id 2568829e5483b879a1fbb05d446f67d5688b90574b0973d24135b69b9e10ad77 Jul 27 16:28:53.916581 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:53.916499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:54.088074 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.088006 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:54.280395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.280355 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vhvk6" event={"ID":"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc","Type":"ContainerStarted","Data":"2568829e5483b879a1fbb05d446f67d5688b90574b0973d24135b69b9e10ad77"} Jul 27 16:28:54.282427 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.282398 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" event={"ID":"28ecb5fb-29b9-404b-811c-09c6122d80cf","Type":"ContainerStarted","Data":"346f3f60051c531db66545f64a0f8fa31a143c755fcbe606ef7747ecf5d30bb4"} Jul 27 16:28:54.300065 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.299682 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-w8rqh" podStartSLOduration=33.684284234 podStartE2EDuration="38.299662312s" totalImagesPullingTime="4.615378078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:28:54.298257265 +0000 UTC m=+279.331568872" watchObservedRunningTime="2026-07-27 16:28:54.299662312 +0000 UTC m=+279.332973919" Jul 27 16:28:54.425015 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.424976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:54.731275 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:54.731212 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:56.968022 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:56.967980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" Jul 27 16:28:56.968022 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:56.967980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mx274" podUID="82db6950-00b0-484f-9f7b-d8b12cd439cc" Jul 27 16:28:57.292834 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:57.292758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:28:57.292988 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:57.292758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mx274" Jul 27 16:28:58.122190 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.122152 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:58.168009 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.167982 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zq7lx"] Jul 27 16:28:58.171488 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.171465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.173448 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.173423 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 16:28:58.174000 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.173977 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 16:28:58.174102 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.173999 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 16:28:58.174102 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.174033 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5cvm8\"" Jul 27 16:28:58.179937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.179916 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zq7lx"] Jul 27 16:28:58.200547 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.200520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:58.241804 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.241775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.241939 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.241891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.241939 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.241925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkm2v\" (UniqueName: \"kubernetes.io/projected/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-kube-api-access-zkm2v\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.242036 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.242006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.343241 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.343190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.343414 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.343252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkm2v\" (UniqueName: \"kubernetes.io/projected/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-kube-api-access-zkm2v\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.343414 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.343305 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.343414 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:58.343403 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 27 16:28:58.343572 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:28:58.343462 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls podName:5befcb9e-ee78-4bdb-bbb5-5201e5013c6a nodeName:}" failed. No retries permitted until 2026-07-27 16:28:58.843443728 +0000 UTC m=+283.876755314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-zq7lx" (UID: "5befcb9e-ee78-4bdb-bbb5-5201e5013c6a") : secret "prometheus-operator-tls" not found Jul 27 16:28:58.343572 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.343489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.344055 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.344039 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.345469 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.345449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.352602 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.352580 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkm2v\" (UniqueName: \"kubernetes.io/projected/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-kube-api-access-zkm2v\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.460673 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.460633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:28:58.847976 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.847880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:58.851592 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:58.851562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5befcb9e-ee78-4bdb-bbb5-5201e5013c6a-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zq7lx\" (UID: \"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:59.082138 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:59.081885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" Jul 27 16:28:59.229486 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:59.229446 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zq7lx"] Jul 27 16:28:59.233493 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:28:59.233459 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5befcb9e_ee78_4bdb_bbb5_5201e5013c6a.slice/crio-ba4f23b85594a6da0d443ba08e4745c1706200cfcc6d3571546a898026339f5f WatchSource:0}: Error finding container ba4f23b85594a6da0d443ba08e4745c1706200cfcc6d3571546a898026339f5f: Status 404 returned error can't find the container with id ba4f23b85594a6da0d443ba08e4745c1706200cfcc6d3571546a898026339f5f Jul 27 16:28:59.301967 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:59.301925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vhvk6" event={"ID":"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc","Type":"ContainerStarted","Data":"f17f758c60bea7a59b15d9b01389b8a3410170c99fb1c39cc0483a4f04032d6a"} Jul 27 16:28:59.303421 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:28:59.303363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" event={"ID":"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a","Type":"ContainerStarted","Data":"ba4f23b85594a6da0d443ba08e4745c1706200cfcc6d3571546a898026339f5f"} Jul 27 16:29:00.324136 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.324101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:00.424466 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.424429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:00.863515 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.863467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:29:00.863707 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.863523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:00.863707 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.863587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:29:00.866317 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.866284 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/82db6950-00b0-484f-9f7b-d8b12cd439cc-metrics-tls\") pod \"dns-default-mx274\" (UID: \"82db6950-00b0-484f-9f7b-d8b12cd439cc\") " pod="openshift-dns/dns-default-mx274" Jul 27 16:29:00.866454 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.866431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"image-registry-7cd8f8fc74-5wfkd\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:00.866545 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.866524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8edff5fd-1054-4406-9015-36f9e28f7382-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-s9vbw\" (UID: \"8edff5fd-1054-4406-9015-36f9e28f7382\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:29:00.895897 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.895871 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pc959\"" Jul 27 16:29:00.896034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.895908 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kc6vj\"" Jul 27 16:29:00.903593 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.903573 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mx274" Jul 27 16:29:00.903710 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:00.903674 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:01.157370 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:01.157297 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6dn5d\"" Jul 27 16:29:01.166028 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:01.165994 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" Jul 27 16:29:02.187202 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.186979 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:29:02.193399 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:02.193373 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcd4bc7_2a27_421b_9a15_559958eb9e3d.slice/crio-caa80f5261efa4fbc140f86194511299de8d2a66c739d1f908208cc83dd94549 WatchSource:0}: Error finding container caa80f5261efa4fbc140f86194511299de8d2a66c739d1f908208cc83dd94549: Status 404 returned error can't find the container with id caa80f5261efa4fbc140f86194511299de8d2a66c739d1f908208cc83dd94549 Jul 27 16:29:02.199107 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.199088 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw"] Jul 27 16:29:02.202550 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:02.202524 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edff5fd_1054_4406_9015_36f9e28f7382.slice/crio-ef884bbcefba05dcd5f59b3f3e799e5a7116289f46a7be6abdf07cc174414785 WatchSource:0}: Error finding container ef884bbcefba05dcd5f59b3f3e799e5a7116289f46a7be6abdf07cc174414785: Status 404 returned error can't find the container with id ef884bbcefba05dcd5f59b3f3e799e5a7116289f46a7be6abdf07cc174414785 Jul 27 16:29:02.230561 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.230486 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mx274"] Jul 27 16:29:02.234435 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:02.234412 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82db6950_00b0_484f_9f7b_d8b12cd439cc.slice/crio-69e0cbe6efd5dbb6488390a63df5e45b040d2e675ee8b0ab4a2ee17e5cb2d94c WatchSource:0}: Error finding container 69e0cbe6efd5dbb6488390a63df5e45b040d2e675ee8b0ab4a2ee17e5cb2d94c: Status 404 returned error can't find the container with id 69e0cbe6efd5dbb6488390a63df5e45b040d2e675ee8b0ab4a2ee17e5cb2d94c Jul 27 16:29:02.318517 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.318096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" event={"ID":"4dcd4bc7-2a27-421b-9a15-559958eb9e3d","Type":"ContainerStarted","Data":"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d"} Jul 27 16:29:02.318517 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.318157 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" event={"ID":"4dcd4bc7-2a27-421b-9a15-559958eb9e3d","Type":"ContainerStarted","Data":"caa80f5261efa4fbc140f86194511299de8d2a66c739d1f908208cc83dd94549"} Jul 27 16:29:02.318837 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.318791 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:02.319856 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.319784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" event={"ID":"8edff5fd-1054-4406-9015-36f9e28f7382","Type":"ContainerStarted","Data":"ef884bbcefba05dcd5f59b3f3e799e5a7116289f46a7be6abdf07cc174414785"} Jul 27 16:29:02.322787 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.322721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mx274" event={"ID":"82db6950-00b0-484f-9f7b-d8b12cd439cc","Type":"ContainerStarted","Data":"69e0cbe6efd5dbb6488390a63df5e45b040d2e675ee8b0ab4a2ee17e5cb2d94c"} Jul 27 16:29:02.325485 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.325451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vhvk6" event={"ID":"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc","Type":"ContainerStarted","Data":"0af54a83dbc76eaea97ea2b6cda9532941becbb45aaf60303e85c9ce6e954e26"} Jul 27 16:29:02.329372 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.329298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" event={"ID":"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a","Type":"ContainerStarted","Data":"c6fa22f8fa45881b9a41cde67a14c9bdb55d42f40b8b1de96e9e4899b0616ff5"} Jul 27 16:29:02.329372 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.329342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" event={"ID":"5befcb9e-ee78-4bdb-bbb5-5201e5013c6a","Type":"ContainerStarted","Data":"7f809761512fcbdf8b9d9c78145025592f15152b40e9765e98c4d47302fc6da2"} Jul 27 16:29:02.340974 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.340929 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podStartSLOduration=286.340915134 podStartE2EDuration="4m46.340915134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:02.340028564 +0000 UTC m=+287.373340173" watchObservedRunningTime="2026-07-27 16:29:02.340915134 +0000 UTC m=+287.374226741" Jul 27 16:29:02.357265 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.357183 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-zq7lx" podStartSLOduration=1.5847671920000002 podStartE2EDuration="4.357163402s" totalImagesPullingTime="2.77239621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:02.355998761 +0000 UTC m=+287.389310367" watchObservedRunningTime="2026-07-27 16:29:02.357163402 +0000 UTC m=+287.390475009" Jul 27 16:29:02.378855 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.378829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:02.936463 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:02.936431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.271273 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.271196 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.338775 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.338742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" event={"ID":"8edff5fd-1054-4406-9015-36f9e28f7382","Type":"ContainerStarted","Data":"c96f8d98024555855b3d938cf369f45da9457c7cb8069251a717599d23700b0c"} Jul 27 16:29:04.361566 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.361506 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-s9vbw" podStartSLOduration=281.963928549 podStartE2EDuration="4m43.36148465s" totalImagesPullingTime="1.397556101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:04.360205566 +0000 UTC m=+289.393517173" watchObservedRunningTime="2026-07-27 16:29:04.36148465 +0000 UTC m=+289.394796250" Jul 27 16:29:04.479784 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.479751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.533210 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.533126 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62"] Jul 27 16:29:04.538267 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.538245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.540410 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.540386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 16:29:04.540520 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.540386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 16:29:04.540520 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.540480 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n6p8c\"" Jul 27 16:29:04.544300 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.544276 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk"] Jul 27 16:29:04.548355 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.548277 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.550800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.550435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 27 16:29:04.550800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.550616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kbldv\"" Jul 27 16:29:04.551160 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.551003 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 27 16:29:04.551335 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.551318 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 27 16:29:04.553820 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.553788 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62"] Jul 27 16:29:04.555069 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.555050 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sxnvr"] Jul 27 16:29:04.558896 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.558878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.560921 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.560852 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk"] Jul 27 16:29:04.561256 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.561207 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 16:29:04.561357 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.561306 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g5zfk\"" Jul 27 16:29:04.561357 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.561304 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 16:29:04.561554 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.561214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 16:29:04.567687 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.567665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.594519 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594489 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.594640 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.594640 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594640 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594589 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594640 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-wtmp\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-metrics-client-ca\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-textfile\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n896\" (UniqueName: \"kubernetes.io/projected/b354d241-6dc4-486c-b5c6-5058cc932bb8-kube-api-access-9n896\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg4b8\" (UniqueName: \"kubernetes.io/projected/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-kube-api-access-xg4b8\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.594980 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.594984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-root\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.595376 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.595006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.595376 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.595052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57a5a4a6-e219-45aa-bd7d-3b7755780436-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.595376 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.595084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mr85\" (UniqueName: \"kubernetes.io/projected/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-api-access-4mr85\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.595376 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.595109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-sys\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.595376 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.595149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.695606 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695569 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n896\" (UniqueName: \"kubernetes.io/projected/b354d241-6dc4-486c-b5c6-5058cc932bb8-kube-api-access-9n896\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.695606 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg4b8\" (UniqueName: \"kubernetes.io/projected/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-kube-api-access-xg4b8\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.695816 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-root\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.695816 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.695911 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695826 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-root\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.695911 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57a5a4a6-e219-45aa-bd7d-3b7755780436-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.695911 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mr85\" (UniqueName: \"kubernetes.io/projected/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-api-access-4mr85\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-sys\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.695969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696030 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-sys\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.696073 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696107 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-wtmp\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-metrics-client-ca\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.696395 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/57a5a4a6-e219-45aa-bd7d-3b7755780436-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-wtmp\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-accelerators-collector-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:04.696735 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:04.696792 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls podName:b354d241-6dc4-486c-b5c6-5058cc932bb8 nodeName:}" failed. No retries permitted until 2026-07-27 16:29:05.196773894 +0000 UTC m=+290.230085480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls") pod "node-exporter-sxnvr" (UID: "b354d241-6dc4-486c-b5c6-5058cc932bb8") : secret "node-exporter-tls" not found Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696823 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-textfile\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.696986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:04.697023 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:04.697069 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls podName:cefe8a3e-89ef-4681-88cf-da3ed1f42ad7 nodeName:}" failed. No retries permitted until 2026-07-27 16:29:05.197053717 +0000 UTC m=+290.230365320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-wkd62" (UID: "cefe8a3e-89ef-4681-88cf-da3ed1f42ad7") : secret "openshift-state-metrics-tls" not found Jul 27 16:29:04.697283 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.697204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354d241-6dc4-486c-b5c6-5058cc932bb8-metrics-client-ca\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.698007 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.697308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-textfile\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.698007 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.697364 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.698687 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.698660 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.698830 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.698660 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.699023 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.699004 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.699437 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.699406 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.704791 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.704766 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n896\" (UniqueName: \"kubernetes.io/projected/b354d241-6dc4-486c-b5c6-5058cc932bb8-kube-api-access-9n896\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:04.705017 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.704997 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mr85\" (UniqueName: \"kubernetes.io/projected/57a5a4a6-e219-45aa-bd7d-3b7755780436-kube-api-access-4mr85\") pod \"kube-state-metrics-56d9f944b4-rv9fk\" (UID: \"57a5a4a6-e219-45aa-bd7d-3b7755780436\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.705104 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.705029 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg4b8\" (UniqueName: \"kubernetes.io/projected/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-kube-api-access-xg4b8\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:04.710168 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.710140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.810775 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.810667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:04.866371 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.866338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" Jul 27 16:29:04.953467 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:04.953436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.137794 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.137700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.202519 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.202490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:05.202655 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.202556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:05.204913 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.204889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354d241-6dc4-486c-b5c6-5058cc932bb8-node-exporter-tls\") pod \"node-exporter-sxnvr\" (UID: \"b354d241-6dc4-486c-b5c6-5058cc932bb8\") " pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:05.205032 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.204956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cefe8a3e-89ef-4681-88cf-da3ed1f42ad7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-wkd62\" (UID: \"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:05.257103 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.257065 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.454120 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.454082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" Jul 27 16:29:05.472393 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.472360 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sxnvr" Jul 27 16:29:05.509110 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.509084 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.599096 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.599062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.712722 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.712638 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:05.810534 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:05.810500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:06.280495 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.280195 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk"] Jul 27 16:29:06.283629 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:06.283598 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a5a4a6_e219_45aa_bd7d_3b7755780436.slice/crio-824417b57042e293ad71e418b65e59d6195caab17840e6abc859b570036f8085 WatchSource:0}: Error finding container 824417b57042e293ad71e418b65e59d6195caab17840e6abc859b570036f8085: Status 404 returned error can't find the container with id 824417b57042e293ad71e418b65e59d6195caab17840e6abc859b570036f8085 Jul 27 16:29:06.300580 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.300557 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62"] Jul 27 16:29:06.305206 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:06.305170 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefe8a3e_89ef_4681_88cf_da3ed1f42ad7.slice/crio-f051a3101e44a09db79a2a88318c7fd9097c562ede9e04aec074cbd45c18bd16 WatchSource:0}: Error finding container f051a3101e44a09db79a2a88318c7fd9097c562ede9e04aec074cbd45c18bd16: Status 404 returned error can't find the container with id f051a3101e44a09db79a2a88318c7fd9097c562ede9e04aec074cbd45c18bd16 Jul 27 16:29:06.348217 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.348156 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mx274" event={"ID":"82db6950-00b0-484f-9f7b-d8b12cd439cc","Type":"ContainerStarted","Data":"ec2f8c7f71df2c53627139e4bca1ec6726cb7be4c22c703f7288a4225f2af3a2"} Jul 27 16:29:06.350565 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.350516 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vhvk6" event={"ID":"749bcdf9-8c7b-44ab-a96c-a3a46a2164bc","Type":"ContainerStarted","Data":"560e222fc66683ebebee06dfe38e602bbe6255a2c1b39504cc0b59130aed4907"} Jul 27 16:29:06.354998 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.352361 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" event={"ID":"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7","Type":"ContainerStarted","Data":"f051a3101e44a09db79a2a88318c7fd9097c562ede9e04aec074cbd45c18bd16"} Jul 27 16:29:06.354998 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.353745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxnvr" event={"ID":"b354d241-6dc4-486c-b5c6-5058cc932bb8","Type":"ContainerStarted","Data":"997fd7faadb4cfd28f0299740ab443db5cf051adcafcece1657801db7fe2f02a"} Jul 27 16:29:06.355337 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.355291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" event={"ID":"57a5a4a6-e219-45aa-bd7d-3b7755780436","Type":"ContainerStarted","Data":"824417b57042e293ad71e418b65e59d6195caab17840e6abc859b570036f8085"} Jul 27 16:29:06.380504 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.380445 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vhvk6" podStartSLOduration=33.967819748 podStartE2EDuration="46.380413178s" totalImagesPullingTime="12.41259343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:28:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:06.378590779 +0000 UTC m=+291.411902387" watchObservedRunningTime="2026-07-27 16:29:06.380413178 +0000 UTC m=+291.413724785" Jul 27 16:29:06.627837 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.627763 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:06.730034 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:06.730002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:07.365038 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.365006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mx274" event={"ID":"82db6950-00b0-484f-9f7b-d8b12cd439cc","Type":"ContainerStarted","Data":"072b9e9998a91c7ee166ce4cc8b357b194381d59f734c14828f589401a5be429"} Jul 27 16:29:07.365183 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.365099 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mx274" Jul 27 16:29:07.367116 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.367084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" event={"ID":"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7","Type":"ContainerStarted","Data":"d706ac18248e606fc36ecb0d017e5ecc4cbf51d9fdc2d989dc75009364e26823"} Jul 27 16:29:07.367247 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.367150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" event={"ID":"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7","Type":"ContainerStarted","Data":"0c2df95d1ad1a7ac5252b727dd0257c4e01862e73f84844f6a685cda640682b6"} Jul 27 16:29:07.368919 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.368891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxnvr" event={"ID":"b354d241-6dc4-486c-b5c6-5058cc932bb8","Type":"ContainerStarted","Data":"6e1b769cc258225bda9848483fe7f0c22329d837f86e03d114b728a6c03e2fea"} Jul 27 16:29:07.383318 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.383269 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mx274" podStartSLOduration=253.500847135 podStartE2EDuration="4m17.383248899s" totalImagesPullingTime="3.882401764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:07.381545442 +0000 UTC m=+292.414857049" watchObservedRunningTime="2026-07-27 16:29:07.383248899 +0000 UTC m=+292.416560505" Jul 27 16:29:07.509968 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.509933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:07.606279 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.606243 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:07.706923 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:07.706871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:08.373982 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.373947 2575 generic.go:356] "Generic (PLEG): container finished" podID="b354d241-6dc4-486c-b5c6-5058cc932bb8" containerID="6e1b769cc258225bda9848483fe7f0c22329d837f86e03d114b728a6c03e2fea" exitCode=0 Jul 27 16:29:08.374146 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.374033 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxnvr" event={"ID":"b354d241-6dc4-486c-b5c6-5058cc932bb8","Type":"ContainerDied","Data":"6e1b769cc258225bda9848483fe7f0c22329d837f86e03d114b728a6c03e2fea"} Jul 27 16:29:08.376115 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.376087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" event={"ID":"cefe8a3e-89ef-4681-88cf-da3ed1f42ad7","Type":"ContainerStarted","Data":"874f5832308a0ae2369cc9e17565204a738fa37c88db296a0ad893438a18610f"} Jul 27 16:29:08.416392 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.416327 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-wkd62" podStartSLOduration=3.243512984 podStartE2EDuration="4.416308526s" totalImagesPullingTime="1.172795542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:08.416104416 +0000 UTC m=+293.449416021" watchObservedRunningTime="2026-07-27 16:29:08.416308526 +0000 UTC m=+293.449620133" Jul 27 16:29:08.455961 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:08.455937 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-56rvn" podUID="57d428b4-7cd5-45ce-b0d5-e84f2fa56d23" Jul 27 16:29:08.838807 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.838772 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-797d4644dc-zzfcq"] Jul 27 16:29:08.840851 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.840834 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.843097 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843066 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 16:29:08.843097 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843087 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-eqf7q3lq5put7\"" Jul 27 16:29:08.843452 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843434 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 16:29:08.843452 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843448 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 16:29:08.843585 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843434 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ccbct\"" Jul 27 16:29:08.843585 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.843439 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 16:29:08.851695 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.851671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797d4644dc-zzfcq"] Jul 27 16:29:08.937438 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-tls\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937561 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tlzj\" (UniqueName: \"kubernetes.io/projected/3ddb6873-fb03-4af7-b10b-2257de59bec1-kube-api-access-8tlzj\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937561 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-client-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937561 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-client-certs\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937561 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ddb6873-fb03-4af7-b10b-2257de59bec1-audit-log\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937760 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:08.937760 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:08.937660 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-metrics-server-audit-profiles\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038697 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ddb6873-fb03-4af7-b10b-2257de59bec1-audit-log\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-metrics-server-audit-profiles\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-tls\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tlzj\" (UniqueName: \"kubernetes.io/projected/3ddb6873-fb03-4af7-b10b-2257de59bec1-kube-api-access-8tlzj\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038996 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-client-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.038996 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.038841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-client-certs\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.039197 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.039174 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ddb6873-fb03-4af7-b10b-2257de59bec1-audit-log\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.039555 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.039527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.039798 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.039774 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ddb6873-fb03-4af7-b10b-2257de59bec1-metrics-server-audit-profiles\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.041255 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.041213 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-client-certs\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.041352 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.041333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-secret-metrics-server-tls\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.041390 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.041373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ddb6873-fb03-4af7-b10b-2257de59bec1-client-ca-bundle\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.046978 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.046953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tlzj\" (UniqueName: \"kubernetes.io/projected/3ddb6873-fb03-4af7-b10b-2257de59bec1-kube-api-access-8tlzj\") pod \"metrics-server-797d4644dc-zzfcq\" (UID: \"3ddb6873-fb03-4af7-b10b-2257de59bec1\") " pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.149730 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.149661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:09.299471 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.299434 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-797d4644dc-zzfcq"] Jul 27 16:29:09.303140 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:09.303115 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddb6873_fb03_4af7_b10b_2257de59bec1.slice/crio-a31c1966c9aa6fd2897444c9510f78babe396f47d7e6b9d0e5ab0e9f00c57ac0 WatchSource:0}: Error finding container a31c1966c9aa6fd2897444c9510f78babe396f47d7e6b9d0e5ab0e9f00c57ac0: Status 404 returned error can't find the container with id a31c1966c9aa6fd2897444c9510f78babe396f47d7e6b9d0e5ab0e9f00c57ac0 Jul 27 16:29:09.312158 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.312126 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:09.334482 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.333758 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd"] Jul 27 16:29:09.336507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.336485 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.338546 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.338524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d49b5\"" Jul 27 16:29:09.338657 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.338563 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 16:29:09.347719 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.347692 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd"] Jul 27 16:29:09.381887 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.381854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" event={"ID":"3ddb6873-fb03-4af7-b10b-2257de59bec1","Type":"ContainerStarted","Data":"a31c1966c9aa6fd2897444c9510f78babe396f47d7e6b9d0e5ab0e9f00c57ac0"} Jul 27 16:29:09.383973 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.383930 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxnvr" event={"ID":"b354d241-6dc4-486c-b5c6-5058cc932bb8","Type":"ContainerStarted","Data":"d3e9195f67b2529fdfc530de826893883d7938ba3e8a311c48cb963482d3eb92"} Jul 27 16:29:09.384064 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.383988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sxnvr" event={"ID":"b354d241-6dc4-486c-b5c6-5058cc932bb8","Type":"ContainerStarted","Data":"f923203a6de96229983c1a3123fc217d40454b0ea2e12b9766d307e5f1e4627c"} Jul 27 16:29:09.392877 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.392829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:09.404400 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.404333 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sxnvr" podStartSLOduration=4.160844488 podStartE2EDuration="5.404317507s" totalImagesPullingTime="1.16845088s" totalInitContainerRuntime="75.022139ms" isStatefulPod=true podCreationTimestamp="2026-07-27 16:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:09.402541945 +0000 UTC m=+294.435853553" watchObservedRunningTime="2026-07-27 16:29:09.404317507 +0000 UTC m=+294.437629113" Jul 27 16:29:09.442656 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.442631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.442814 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.442791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6rt5\" (UniqueName: \"kubernetes.io/projected/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-kube-api-access-v6rt5\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.543961 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.543928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6rt5\" (UniqueName: \"kubernetes.io/projected/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-kube-api-access-v6rt5\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.544120 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.544040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.544208 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:09.544185 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 16:29:09.544301 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:09.544289 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert podName:9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f nodeName:}" failed. No retries permitted until 2026-07-27 16:29:10.044267639 +0000 UTC m=+295.077579240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-jfxhd" (UID: "9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f") : secret "monitoring-plugin-cert" not found Jul 27 16:29:09.552604 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.552579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6rt5\" (UniqueName: \"kubernetes.io/projected/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-kube-api-access-v6rt5\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:09.603605 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:09.603568 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:10.048620 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.048579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:10.051039 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.051012 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-jfxhd\" (UID: \"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:10.249013 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.248966 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:10.391359 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.391326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" event={"ID":"57a5a4a6-e219-45aa-bd7d-3b7755780436","Type":"ContainerStarted","Data":"272825aa1c61afbc2e9bf45f912f1cfdb77028b7938bce551e7681e26f3fb5d5"} Jul 27 16:29:10.391495 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.391388 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" event={"ID":"57a5a4a6-e219-45aa-bd7d-3b7755780436","Type":"ContainerStarted","Data":"2c0c233e2ce9d347f540d62d3ed6ff84c15488338350a86464034cb79f04b4db"} Jul 27 16:29:10.391495 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.391410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" event={"ID":"57a5a4a6-e219-45aa-bd7d-3b7755780436","Type":"ContainerStarted","Data":"9f62a623782a31e161e9e2a408892e1fa0d98477be448f90bd2ce2c4a8faf7e7"} Jul 27 16:29:10.396168 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.396140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd"] Jul 27 16:29:10.399690 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:29:10.399659 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0e94d7_f8b0_4dc8_b0fd_71b755bf3f2f.slice/crio-2c52dc11b60191962c9e3557345f283b6032c9d53ce9bf606ec2e26678ca88f1 WatchSource:0}: Error finding container 2c52dc11b60191962c9e3557345f283b6032c9d53ce9bf606ec2e26678ca88f1: Status 404 returned error can't find the container with id 2c52dc11b60191962c9e3557345f283b6032c9d53ce9bf606ec2e26678ca88f1 Jul 27 16:29:10.432325 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.432283 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-rv9fk" podStartSLOduration=2.652922728 podStartE2EDuration="6.432269212s" totalImagesPullingTime="3.779346484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:10.429590941 +0000 UTC m=+295.462902547" watchObservedRunningTime="2026-07-27 16:29:10.432269212 +0000 UTC m=+295.465580817" Jul 27 16:29:10.807006 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:10.806976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:11.395544 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:11.395506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" event={"ID":"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f","Type":"ContainerStarted","Data":"2c52dc11b60191962c9e3557345f283b6032c9d53ce9bf606ec2e26678ca88f1"} Jul 27 16:29:12.401177 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:12.401137 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" event={"ID":"9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f","Type":"ContainerStarted","Data":"1d2ac56c47e50ec7b17fe337dd0bf1c1a0a585ab0891a2f5e5c6ba97a1e7bf20"} Jul 27 16:29:12.401685 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:12.401316 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:12.406975 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:12.406952 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" Jul 27 16:29:12.418534 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:12.418482 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-jfxhd" podStartSLOduration=1.956429032 podStartE2EDuration="3.418465106s" totalImagesPullingTime="1.462036074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:12.416905164 +0000 UTC m=+297.450216771" watchObservedRunningTime="2026-07-27 16:29:12.418465106 +0000 UTC m=+297.451776693" Jul 27 16:29:13.407021 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:13.406977 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" event={"ID":"3ddb6873-fb03-4af7-b10b-2257de59bec1","Type":"ContainerStarted","Data":"573947f1a16bb32d71b71a8e103dd3e162b298a7e4a04d3410b7a53823d356a6"} Jul 27 16:29:13.428170 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:13.428123 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" podStartSLOduration=1.827893301 podStartE2EDuration="5.428107832s" totalImagesPullingTime="3.600214531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:29:13.427124546 +0000 UTC m=+298.460436153" watchObservedRunningTime="2026-07-27 16:29:13.428107832 +0000 UTC m=+298.461419438" Jul 27 16:29:15.315011 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:15.314985 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 16:29:16.740827 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:16.740789 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:16.841520 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:16.841488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:17.378727 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:17.378701 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mx274" Jul 27 16:29:19.458822 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:19.458791 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:29:20.141006 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:20.140971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:20.908571 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:20.908538 2575 patch_prober.go:28] interesting pod/image-registry-7cd8f8fc74-5wfkd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 16:29:20.908950 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:20.908585 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 16:29:21.245302 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.245272 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:29:21.249281 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.249256 2575 patch_prober.go:28] interesting pod/image-registry-7cd8f8fc74-5wfkd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 16:29:21.249398 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.249296 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 16:29:21.436196 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.436166 2575 generic.go:356] "Generic (PLEG): container finished" podID="5a12d570-6ac6-436b-9364-91aaac93ea0d" containerID="bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4" exitCode=255 Jul 27 16:29:21.436359 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.436251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerDied","Data":"bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4"} Jul 27 16:29:21.436359 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.436304 2575 scope.go:117] "RemoveContainer" containerID="b2302e5abd30faf1fb8d4d42ecba16bc7f8efe1473dbf872f648e858899c1f69" Jul 27 16:29:21.442362 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.442343 2575 scope.go:117] "RemoveContainer" containerID="bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4" Jul 27 16:29:21.442499 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:21.442486 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd_open-cluster-management-agent-addon(5a12d570-6ac6-436b-9364-91aaac93ea0d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" podUID="5a12d570-6ac6-436b-9364-91aaac93ea0d" Jul 27 16:29:21.559964 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:21.559929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:22.874253 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:22.874185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:22.941668 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:22.941641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:24.521784 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:24.521736 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:24.952612 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:24.952577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:25.134789 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:25.134757 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" Jul 27 16:29:25.135087 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:25.135073 2575 scope.go:117] "RemoveContainer" containerID="bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4" Jul 27 16:29:25.135245 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:25.135209 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd_open-cluster-management-agent-addon(5a12d570-6ac6-436b-9364-91aaac93ea0d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" podUID="5a12d570-6ac6-436b-9364-91aaac93ea0d" Jul 27 16:29:26.538900 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:26.538868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:26.594670 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:26.594641 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:29.150658 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:29.150625 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:29.151054 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:29.150704 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:30.469363 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:30.469327 2575 generic.go:356] "Generic (PLEG): container finished" podID="921f1436-e1f0-499e-b580-02b6a6b07916" containerID="ed1c5f857edfa38fbc405710158ae8e8fb8b2ce3750b4c97fdeaf43bb4cdd5b6" exitCode=0 Jul 27 16:29:30.469844 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:30.469407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" event={"ID":"921f1436-e1f0-499e-b580-02b6a6b07916","Type":"ContainerDied","Data":"ed1c5f857edfa38fbc405710158ae8e8fb8b2ce3750b4c97fdeaf43bb4cdd5b6"} Jul 27 16:29:30.469844 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:30.469833 2575 scope.go:117] "RemoveContainer" containerID="ed1c5f857edfa38fbc405710158ae8e8fb8b2ce3750b4c97fdeaf43bb4cdd5b6" Jul 27 16:29:31.250254 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:31.250207 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:31.302693 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:31.302661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:31.402685 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:31.402640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:31.474489 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:31.474462 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz" event={"ID":"921f1436-e1f0-499e-b580-02b6a6b07916","Type":"ContainerStarted","Data":"e257869745670b42cf2f00df3c181a6cee07eee6b3b6214c4935c46d26ebe85d"} Jul 27 16:29:31.504183 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:31.504089 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:35.530202 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:35.530169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:36.454890 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:36.454859 2575 scope.go:117] "RemoveContainer" containerID="bfc9529019bd5a989f47fd5444883a39cc4339605033a0c5386a03c68feb1cd4" Jul 27 16:29:36.642732 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:36.642691 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:36.739888 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:36.739800 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:37.497419 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:37.497383 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5444dc5bc4-sz2qd" event={"ID":"5a12d570-6ac6-436b-9364-91aaac93ea0d","Type":"ContainerStarted","Data":"2203ebfdc0732e7f9de7095c44c16cc5a0287bdeb521e46dd4243cfb85be30a1"} Jul 27 16:29:38.138368 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:38.138319 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:38.210603 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:38.210574 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:38.636848 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:38.636809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:44.573121 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:44.573079 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:45.913090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:45.913057 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbfd4d8d9-sqnwx_1805f4e9-6308-47e7-b140-8e31fabd07b5/router/0.log" Jul 27 16:29:46.263586 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.263545 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" containerID="cri-o://aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d" gracePeriod=30 Jul 27 16:29:46.278557 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.278537 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbr49_55f68011-1582-411b-afa5-862e9ab575f8/serve-healthcheck-canary/0.log" Jul 27 16:29:46.502617 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.502594 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:46.530856 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.530780 2575 generic.go:356] "Generic (PLEG): container finished" podID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerID="aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d" exitCode=0 Jul 27 16:29:46.530856 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.530841 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" Jul 27 16:29:46.531014 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.530871 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" event={"ID":"4dcd4bc7-2a27-421b-9a15-559958eb9e3d","Type":"ContainerDied","Data":"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d"} Jul 27 16:29:46.531014 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.530932 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cd8f8fc74-5wfkd" event={"ID":"4dcd4bc7-2a27-421b-9a15-559958eb9e3d","Type":"ContainerDied","Data":"caa80f5261efa4fbc140f86194511299de8d2a66c739d1f908208cc83dd94549"} Jul 27 16:29:46.531014 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.530962 2575 scope.go:117] "RemoveContainer" containerID="aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d" Jul 27 16:29:46.539453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.539429 2575 scope.go:117] "RemoveContainer" containerID="aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d" Jul 27 16:29:46.539765 ip-10-0-128-172 kubenswrapper[2575]: E0727 16:29:46.539741 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d\": container with ID starting with aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d not found: ID does not exist" containerID="aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d" Jul 27 16:29:46.539819 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.539777 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d"} err="failed to get container status \"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d\": rpc error: code = NotFound desc = could not find container \"aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d\": container with ID starting with aa7ee3baf739aa178306e9921d08ca6f6e0e4b64866fe5eee4b59ce815c3460d not found: ID does not exist" Jul 27 16:29:46.653070 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653047 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653234 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653091 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653234 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653122 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653234 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653150 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653234 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653172 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxzn5\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653234 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653201 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653478 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653274 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653478 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653306 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token\") pod \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\" (UID: \"4dcd4bc7-2a27-421b-9a15-559958eb9e3d\") " Jul 27 16:29:46.653678 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.653628 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:46.654077 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.654053 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 16:29:46.655506 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.655486 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:46.655651 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.655627 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5" (OuterVolumeSpecName: "kube-api-access-hxzn5") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "kube-api-access-hxzn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:29:46.655702 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.655638 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 16:29:46.655922 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.655903 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:29:46.655922 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.655904 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:29:46.664640 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.664607 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4dcd4bc7-2a27-421b-9a15-559958eb9e3d" (UID: "4dcd4bc7-2a27-421b-9a15-559958eb9e3d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:29:46.754535 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754504 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-bound-sa-token\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754535 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754534 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-image-registry-private-configuration\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754548 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-installation-pull-secrets\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754562 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-certificates\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754573 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-ca-trust-extracted\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754585 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxzn5\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-kube-api-access-hxzn5\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754597 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-registry-tls\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.754680 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.754607 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dcd4bc7-2a27-421b-9a15-559958eb9e3d-trusted-ca\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:29:46.850449 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.850425 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:29:46.854800 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:46.854773 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cd8f8fc74-5wfkd"] Jul 27 16:29:47.341953 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:47.341926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:47.458371 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:47.458339 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" path="/var/lib/kubelet/pods/4dcd4bc7-2a27-421b-9a15-559958eb9e3d/volumes" Jul 27 16:29:47.494641 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:47.494613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:49.155199 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:49.155166 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:49.159119 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:49.159094 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-797d4644dc-zzfcq" Jul 27 16:29:51.623269 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:51.623216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:29:51.720129 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:29:51.720093 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:02.532198 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:02.532155 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:02.632362 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:02.632323 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:02.705942 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:02.705911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:06.619262 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:06.619216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:06.777585 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:06.777555 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:23.925869 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:23.925824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:24.230582 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:24.230538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:29.052633 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.052593 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54dff9dbb-blh2k"] Jul 27 16:30:29.053010 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.052907 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" Jul 27 16:30:29.053010 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.052918 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" Jul 27 16:30:29.053010 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.052976 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcd4bc7-2a27-421b-9a15-559958eb9e3d" containerName="registry" Jul 27 16:30:29.056046 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.056019 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.058907 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.058870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 27 16:30:29.058907 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.058896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 27 16:30:29.059106 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.058909 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 27 16:30:29.059507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.059481 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 27 16:30:29.059611 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.059570 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 27 16:30:29.059773 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.059757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4frhf\"" Jul 27 16:30:29.066140 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.066121 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 27 16:30:29.086543 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.086513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54dff9dbb-blh2k"] Jul 27 16:30:29.192321 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-serving-certs-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-federate-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192584 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192483 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192584 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-metrics-client-ca\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192584 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cxj8\" (UniqueName: \"kubernetes.io/projected/5ad22227-f26d-49f3-82ab-f92d5511f4e3-kube-api-access-4cxj8\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192584 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.192702 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.192612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:30:29.194896 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.194878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57d428b4-7cd5-45ce-b0d5-e84f2fa56d23-metrics-certs\") pod \"network-metrics-daemon-56rvn\" (UID: \"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23\") " pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:30:29.293533 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293497 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-serving-certs-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-federate-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293655 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293690 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-metrics-client-ca\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cxj8\" (UniqueName: \"kubernetes.io/projected/5ad22227-f26d-49f3-82ab-f92d5511f4e3-kube-api-access-4cxj8\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.293734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.293725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.294485 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.294453 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-serving-certs-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.294721 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.294696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-metrics-client-ca\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.294872 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.294753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.296121 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.296097 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.296290 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.296273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-federate-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.296404 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.296384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-secret-telemeter-client\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.296450 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.296417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5ad22227-f26d-49f3-82ab-f92d5511f4e3-telemeter-client-tls\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.302101 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.302080 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cxj8\" (UniqueName: \"kubernetes.io/projected/5ad22227-f26d-49f3-82ab-f92d5511f4e3-kube-api-access-4cxj8\") pod \"telemeter-client-54dff9dbb-blh2k\" (UID: \"5ad22227-f26d-49f3-82ab-f92d5511f4e3\") " pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.362618 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.362532 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrtwx\"" Jul 27 16:30:29.368543 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.368514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" Jul 27 16:30:29.370609 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.370588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56rvn" Jul 27 16:30:29.515009 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.514981 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-56rvn"] Jul 27 16:30:29.519527 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:30:29.519501 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d428b4_7cd5_45ce_b0d5_e84f2fa56d23.slice/crio-2babf1cec2837c16c03f9b75927a510dd3443ccf57a9b2f4581a13eb1940c01e WatchSource:0}: Error finding container 2babf1cec2837c16c03f9b75927a510dd3443ccf57a9b2f4581a13eb1940c01e: Status 404 returned error can't find the container with id 2babf1cec2837c16c03f9b75927a510dd3443ccf57a9b2f4581a13eb1940c01e Jul 27 16:30:29.521507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.521491 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:30:29.536203 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.536176 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54dff9dbb-blh2k"] Jul 27 16:30:29.540032 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:30:29.540012 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad22227_f26d_49f3_82ab_f92d5511f4e3.slice/crio-7fc7c761d5ffbd19f0a0397cf0242b6e85f6faefad08d6a4bfed85cd3563d92d WatchSource:0}: Error finding container 7fc7c761d5ffbd19f0a0397cf0242b6e85f6faefad08d6a4bfed85cd3563d92d: Status 404 returned error can't find the container with id 7fc7c761d5ffbd19f0a0397cf0242b6e85f6faefad08d6a4bfed85cd3563d92d Jul 27 16:30:29.695349 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.695311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56rvn" event={"ID":"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23","Type":"ContainerStarted","Data":"2babf1cec2837c16c03f9b75927a510dd3443ccf57a9b2f4581a13eb1940c01e"} Jul 27 16:30:29.696366 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:29.696340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" event={"ID":"5ad22227-f26d-49f3-82ab-f92d5511f4e3","Type":"ContainerStarted","Data":"7fc7c761d5ffbd19f0a0397cf0242b6e85f6faefad08d6a4bfed85cd3563d92d"} Jul 27 16:30:30.706572 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:30.706533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56rvn" event={"ID":"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23","Type":"ContainerStarted","Data":"0c729912da89ab38220aa5345251e33ecf200dd3d744c0014ccc5f5cb22de6cd"} Jul 27 16:30:30.706975 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:30.706609 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56rvn" event={"ID":"57d428b4-7cd5-45ce-b0d5-e84f2fa56d23","Type":"ContainerStarted","Data":"36cd0e4e23e641c0201fbd0b5e4b6de28e0697b5c363b0533fd78c2817165373"} Jul 27 16:30:30.727329 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:30.727270 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-56rvn" podStartSLOduration=373.748515439 podStartE2EDuration="6m14.727252126s" totalImagesPullingTime="978.736687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:30.725087962 +0000 UTC m=+375.758399569" watchObservedRunningTime="2026-07-27 16:30:30.727252126 +0000 UTC m=+375.760563732" Jul 27 16:30:30.838883 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:30.838793 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:30.913712 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:30.913683 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:32.716351 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:32.716315 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" event={"ID":"5ad22227-f26d-49f3-82ab-f92d5511f4e3","Type":"ContainerStarted","Data":"c9c3f2ef4b658eaec596793781f38f1efd64cc2ec7afc51d7df29baf376dc67f"} Jul 27 16:30:34.726659 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:34.726628 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" event={"ID":"5ad22227-f26d-49f3-82ab-f92d5511f4e3","Type":"ContainerStarted","Data":"e5e50ac41967db6e95df7d20d5e78d057706668e7f7a1c71ddb479979b6782ae"} Jul 27 16:30:34.727031 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:34.726683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" event={"ID":"5ad22227-f26d-49f3-82ab-f92d5511f4e3","Type":"ContainerStarted","Data":"72d4cbf29ce8ad5c38587f096580204125ac1dcc219456decf66a9abe9a2cf24"} Jul 27 16:30:34.755324 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:34.755215 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54dff9dbb-blh2k" podStartSLOduration=1.156336369 podStartE2EDuration="5.755199677s" totalImagesPullingTime="4.598863308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:34.754446245 +0000 UTC m=+379.787757852" watchObservedRunningTime="2026-07-27 16:30:34.755199677 +0000 UTC m=+379.788511283" Jul 27 16:30:35.823886 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:35.823848 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:39.289545 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:39.289512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:39.359119 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:39.359081 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:39.847901 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:39.847868 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:39.942508 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:39.942474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:40.667882 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:40.667840 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:40.745120 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:40.745092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:51.025138 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:51.025103 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:51.190165 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:51.190128 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:30:51.253920 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:30:51.253891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:06.634060 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:06.634024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:06.732785 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:06.732752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:06.833075 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:06.833026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:16.055655 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:16.055619 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:27.597515 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:27.597470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:38.782679 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:38.782597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:53.613416 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:53.613381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:53.716724 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:53.716686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:31:54.336975 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.336939 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm"] Jul 27 16:31:54.339510 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.339493 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.344158 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.344139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ddrcp\"" Jul 27 16:31:54.344288 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.344261 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:31:54.344656 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.344637 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:31:54.358799 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.358778 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm"] Jul 27 16:31:54.462510 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.462477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.462510 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.462513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxmdl\" (UniqueName: \"kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.462699 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.462562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.563610 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.563563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.563783 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.563656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.563783 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.563684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxmdl\" (UniqueName: \"kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.563966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.563947 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.564044 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.564022 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.579217 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.579192 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxmdl\" (UniqueName: \"kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.649061 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.648961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:31:54.781428 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:54.781306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm"] Jul 27 16:31:54.784203 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:31:54.784177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd071652_aa83_47af_8056_65ab0d769a3c.slice/crio-c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e WatchSource:0}: Error finding container c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e: Status 404 returned error can't find the container with id c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e Jul 27 16:31:55.014774 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:31:55.014741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" event={"ID":"cd071652-aa83-47af-8056-65ab0d769a3c","Type":"ContainerStarted","Data":"c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e"} Jul 27 16:32:03.046860 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:03.046820 2575 generic.go:356] "Generic (PLEG): container finished" podID="cd071652-aa83-47af-8056-65ab0d769a3c" containerID="c787e066485be5be5f2ba48fc487f30805eefbdd3880938d613ba6c69fcae977" exitCode=0 Jul 27 16:32:03.047242 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:03.046891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" event={"ID":"cd071652-aa83-47af-8056-65ab0d769a3c","Type":"ContainerDied","Data":"c787e066485be5be5f2ba48fc487f30805eefbdd3880938d613ba6c69fcae977"} Jul 27 16:32:06.060465 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:06.060422 2575 generic.go:356] "Generic (PLEG): container finished" podID="cd071652-aa83-47af-8056-65ab0d769a3c" containerID="d4ad43d012e33f66d9f6d7fd907760e38e9d8edeaf91ad8f0cfe305e83e22e41" exitCode=0 Jul 27 16:32:06.060845 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:06.060474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" event={"ID":"cd071652-aa83-47af-8056-65ab0d769a3c","Type":"ContainerDied","Data":"d4ad43d012e33f66d9f6d7fd907760e38e9d8edeaf91ad8f0cfe305e83e22e41"} Jul 27 16:32:15.104876 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:15.104837 2575 generic.go:356] "Generic (PLEG): container finished" podID="cd071652-aa83-47af-8056-65ab0d769a3c" containerID="70fa31e0603ca44eed4f12625a1f40312eb3040df3633a3ece5b9d9479b7df01" exitCode=0 Jul 27 16:32:15.105294 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:15.104916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" event={"ID":"cd071652-aa83-47af-8056-65ab0d769a3c","Type":"ContainerDied","Data":"70fa31e0603ca44eed4f12625a1f40312eb3040df3633a3ece5b9d9479b7df01"} Jul 27 16:32:16.250211 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.250185 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:32:16.339950 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.339923 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util\") pod \"cd071652-aa83-47af-8056-65ab0d769a3c\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " Jul 27 16:32:16.340090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.339962 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxmdl\" (UniqueName: \"kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl\") pod \"cd071652-aa83-47af-8056-65ab0d769a3c\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " Jul 27 16:32:16.340090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.340018 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle\") pod \"cd071652-aa83-47af-8056-65ab0d769a3c\" (UID: \"cd071652-aa83-47af-8056-65ab0d769a3c\") " Jul 27 16:32:16.340756 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.340725 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle" (OuterVolumeSpecName: "bundle") pod "cd071652-aa83-47af-8056-65ab0d769a3c" (UID: "cd071652-aa83-47af-8056-65ab0d769a3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:32:16.342165 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.342142 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl" (OuterVolumeSpecName: "kube-api-access-sxmdl") pod "cd071652-aa83-47af-8056-65ab0d769a3c" (UID: "cd071652-aa83-47af-8056-65ab0d769a3c"). InnerVolumeSpecName "kube-api-access-sxmdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:32:16.344101 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.344076 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util" (OuterVolumeSpecName: "util") pod "cd071652-aa83-47af-8056-65ab0d769a3c" (UID: "cd071652-aa83-47af-8056-65ab0d769a3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:32:16.440780 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.440753 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:16.440780 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.440778 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd071652-aa83-47af-8056-65ab0d769a3c-util\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:16.440954 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:16.440789 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxmdl\" (UniqueName: \"kubernetes.io/projected/cd071652-aa83-47af-8056-65ab0d769a3c-kube-api-access-sxmdl\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:17.114595 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:17.114567 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" Jul 27 16:32:17.114757 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:17.114570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409nlfm" event={"ID":"cd071652-aa83-47af-8056-65ab0d769a3c","Type":"ContainerDied","Data":"c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e"} Jul 27 16:32:17.114757 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:17.114687 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c354681f078b848f612e5c5f2aa0035128ba0274f44ac1923b7973300454224e" Jul 27 16:32:20.475733 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:20.475700 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:21.519496 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:21.519449 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:22.785061 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785027 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt"] Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785346 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="util" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785359 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="util" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785368 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="extract" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785373 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="extract" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785389 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="pull" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785395 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="pull" Jul 27 16:32:22.785453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.785442 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd071652-aa83-47af-8056-65ab0d769a3c" containerName="extract" Jul 27 16:32:22.788992 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.788974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:22.792248 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.792214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dflzs\"" Jul 27 16:32:22.792398 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.792340 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 27 16:32:22.792450 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.792401 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:32:22.806728 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.806703 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt"] Jul 27 16:32:22.892372 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.892334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshpd\" (UniqueName: \"kubernetes.io/projected/cdccc41c-4ee4-4250-82b4-5042bce81555-kube-api-access-qshpd\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:22.892554 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.892398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdccc41c-4ee4-4250-82b4-5042bce81555-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:22.993651 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.993609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdccc41c-4ee4-4250-82b4-5042bce81555-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:22.993801 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.993754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshpd\" (UniqueName: \"kubernetes.io/projected/cdccc41c-4ee4-4250-82b4-5042bce81555-kube-api-access-qshpd\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:22.993998 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:22.993979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdccc41c-4ee4-4250-82b4-5042bce81555-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:23.006854 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:23.006828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshpd\" (UniqueName: \"kubernetes.io/projected/cdccc41c-4ee4-4250-82b4-5042bce81555-kube-api-access-qshpd\") pod \"cert-manager-operator-controller-manager-56b4598547-tx8qt\" (UID: \"cdccc41c-4ee4-4250-82b4-5042bce81555\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:23.098453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:23.098357 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" Jul 27 16:32:23.249156 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:23.249123 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt"] Jul 27 16:32:23.253545 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:32:23.253516 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdccc41c_4ee4_4250_82b4_5042bce81555.slice/crio-2b6fdb34a18518ae4f2e6e56c624a1af8bdaa7ae8c84de008bf59da028ff4859 WatchSource:0}: Error finding container 2b6fdb34a18518ae4f2e6e56c624a1af8bdaa7ae8c84de008bf59da028ff4859: Status 404 returned error can't find the container with id 2b6fdb34a18518ae4f2e6e56c624a1af8bdaa7ae8c84de008bf59da028ff4859 Jul 27 16:32:24.144359 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:24.144328 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" event={"ID":"cdccc41c-4ee4-4250-82b4-5042bce81555","Type":"ContainerStarted","Data":"2b6fdb34a18518ae4f2e6e56c624a1af8bdaa7ae8c84de008bf59da028ff4859"} Jul 27 16:32:24.761340 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:24.761300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:24.855856 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:24.855820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:25.150742 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:25.150663 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" event={"ID":"cdccc41c-4ee4-4250-82b4-5042bce81555","Type":"ContainerStarted","Data":"5d8154f459689ab4ded8f0a0257690eebc2f4080ab60c0035f57d55172244d80"} Jul 27 16:32:25.193413 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:25.193355 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-tx8qt" podStartSLOduration=1.570853988 podStartE2EDuration="3.193336913s" totalImagesPullingTime="1.622482925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:32:25.191104769 +0000 UTC m=+490.224416377" watchObservedRunningTime="2026-07-27 16:32:25.193336913 +0000 UTC m=+490.226648519" Jul 27 16:32:26.904563 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:26.904529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:27.019608 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.019522 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:27.333796 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.333720 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6k7sc"] Jul 27 16:32:27.335978 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.335963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.347948 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.347929 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n9bq5\"" Jul 27 16:32:27.348272 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.348256 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 16:32:27.348810 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.348797 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 16:32:27.363190 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.363158 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6k7sc"] Jul 27 16:32:27.430702 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.430662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjcsx\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-kube-api-access-tjcsx\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.430880 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.430797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.532035 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.531989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjcsx\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-kube-api-access-tjcsx\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.532277 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.532203 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.550708 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.550682 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjcsx\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-kube-api-access-tjcsx\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.551950 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.551922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0c6d3fe-d8d7-4104-83e7-c3376766e2c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6k7sc\" (UID: \"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.644491 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.644398 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:27.774828 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:27.774803 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6k7sc"] Jul 27 16:32:27.777259 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:32:27.777230 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0c6d3fe_d8d7_4104_83e7_c3376766e2c3.slice/crio-79d0b2123c8f72717b7d187328e8480efc9db96bc0f0e9575e67c3c2985b1e32 WatchSource:0}: Error finding container 79d0b2123c8f72717b7d187328e8480efc9db96bc0f0e9575e67c3c2985b1e32: Status 404 returned error can't find the container with id 79d0b2123c8f72717b7d187328e8480efc9db96bc0f0e9575e67c3c2985b1e32 Jul 27 16:32:28.164406 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:28.164372 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" event={"ID":"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3","Type":"ContainerStarted","Data":"79d0b2123c8f72717b7d187328e8480efc9db96bc0f0e9575e67c3c2985b1e32"} Jul 27 16:32:28.842871 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:28.842835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:29.440532 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:29.440494 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:29.537425 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:29.537382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:31.181040 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:31.180993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" event={"ID":"b0c6d3fe-d8d7-4104-83e7-c3376766e2c3","Type":"ContainerStarted","Data":"cf0eed8e742c686c96bc5d35bcbbd52b0b3b9e9fdbb401ed97f0477500e6844e"} Jul 27 16:32:31.181481 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:31.181148 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:31.200211 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:31.200157 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" podStartSLOduration=1.770303689 podStartE2EDuration="4.200145133s" totalImagesPullingTime="2.429841444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:32:31.198154948 +0000 UTC m=+496.231466551" watchObservedRunningTime="2026-07-27 16:32:31.200145133 +0000 UTC m=+496.233456739" Jul 27 16:32:37.186987 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:37.186952 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6k7sc" Jul 27 16:32:37.803776 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:37.803744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:39.603809 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:39.603776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:39.673761 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:39.673722 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:47.735716 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.735683 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p2hxh"] Jul 27 16:32:47.759496 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.759462 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p2hxh"] Jul 27 16:32:47.759669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.759554 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:47.761484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.761461 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wrc9v\"" Jul 27 16:32:47.897813 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.897777 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-bound-sa-token\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:47.897984 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.897864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9nxx\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-kube-api-access-g9nxx\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:47.999191 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.999104 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-bound-sa-token\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:47.999356 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:47.999250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9nxx\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-kube-api-access-g9nxx\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:48.007669 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:48.007631 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-bound-sa-token\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:48.007793 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:48.007746 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9nxx\" (UniqueName: \"kubernetes.io/projected/1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e-kube-api-access-g9nxx\") pod \"cert-manager-55b4d954d5-p2hxh\" (UID: \"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e\") " pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:48.068335 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:48.068297 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-p2hxh" Jul 27 16:32:48.221715 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:48.221683 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-p2hxh"] Jul 27 16:32:48.224576 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:32:48.224525 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c3c7ec1_9c84_4c1e_bf12_8a4b099da86e.slice/crio-9602c1e5be0294ca8497aae340d2771f18400ba9f5fbb76a0e5642e3d1a3e40c WatchSource:0}: Error finding container 9602c1e5be0294ca8497aae340d2771f18400ba9f5fbb76a0e5642e3d1a3e40c: Status 404 returned error can't find the container with id 9602c1e5be0294ca8497aae340d2771f18400ba9f5fbb76a0e5642e3d1a3e40c Jul 27 16:32:48.258071 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:48.257983 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p2hxh" event={"ID":"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e","Type":"ContainerStarted","Data":"9602c1e5be0294ca8497aae340d2771f18400ba9f5fbb76a0e5642e3d1a3e40c"} Jul 27 16:32:49.263415 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.263379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-p2hxh" event={"ID":"1c3c7ec1-9c84-4c1e-bf12-8a4b099da86e","Type":"ContainerStarted","Data":"cab3fd296707f588f5fa2f68bbc18117cec4616d01126cd8ebd70711157e4ab6"} Jul 27 16:32:49.282689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.282638 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-p2hxh" podStartSLOduration=2.282622857 podStartE2EDuration="2.282622857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:32:49.281170779 +0000 UTC m=+514.314482384" watchObservedRunningTime="2026-07-27 16:32:49.282622857 +0000 UTC m=+514.315934462" Jul 27 16:32:49.467891 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.467854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:49.568780 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.568686 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:49.641659 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.641620 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm"] Jul 27 16:32:49.644707 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.644681 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.646750 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.646715 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 16:32:49.646887 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.646800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ddrcp\"" Jul 27 16:32:49.647262 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.647243 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 16:32:49.655341 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.655319 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm"] Jul 27 16:32:49.816354 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.816312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.816532 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.816372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.816532 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.816412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gsz\" (UniqueName: \"kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.916879 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.916796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.916879 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.916862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.917054 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.916900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52gsz\" (UniqueName: \"kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.917290 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.917269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.917330 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.917291 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.925895 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.925865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gsz\" (UniqueName: \"kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:49.954839 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:49.954812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:50.089405 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:50.089372 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm"] Jul 27 16:32:50.093275 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:32:50.093242 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bae1a97_c19f_4ce0_bf23_fef3c604efd5.slice/crio-ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60 WatchSource:0}: Error finding container ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60: Status 404 returned error can't find the container with id ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60 Jul 27 16:32:50.271367 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:50.271330 2575 generic.go:356] "Generic (PLEG): container finished" podID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerID="1e24ab6adcd02b299c534a3e1b971d0c65fcd6028699bd17bef1aa55bc15e371" exitCode=0 Jul 27 16:32:50.271832 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:50.271382 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" event={"ID":"8bae1a97-c19f-4ce0-bf23-fef3c604efd5","Type":"ContainerDied","Data":"1e24ab6adcd02b299c534a3e1b971d0c65fcd6028699bd17bef1aa55bc15e371"} Jul 27 16:32:50.271832 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:50.271438 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" event={"ID":"8bae1a97-c19f-4ce0-bf23-fef3c604efd5","Type":"ContainerStarted","Data":"ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60"} Jul 27 16:32:52.283299 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:52.283272 2575 generic.go:356] "Generic (PLEG): container finished" podID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerID="8ba606a08f805bca8bac42a2d4a5ecf88bf198c8840debac516a54d063109694" exitCode=0 Jul 27 16:32:52.283603 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:52.283348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" event={"ID":"8bae1a97-c19f-4ce0-bf23-fef3c604efd5","Type":"ContainerDied","Data":"8ba606a08f805bca8bac42a2d4a5ecf88bf198c8840debac516a54d063109694"} Jul 27 16:32:53.289886 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:53.289851 2575 generic.go:356] "Generic (PLEG): container finished" podID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerID="bce077802a8bf1c62770062e531ca424190e97b216305ac3d9c990d9aca364b6" exitCode=0 Jul 27 16:32:53.290299 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:53.289907 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" event={"ID":"8bae1a97-c19f-4ce0-bf23-fef3c604efd5","Type":"ContainerDied","Data":"bce077802a8bf1c62770062e531ca424190e97b216305ac3d9c990d9aca364b6"} Jul 27 16:32:54.417529 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.417499 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:54.558627 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.558522 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle\") pod \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " Jul 27 16:32:54.558627 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.558604 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util\") pod \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " Jul 27 16:32:54.558627 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.558629 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52gsz\" (UniqueName: \"kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz\") pod \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\" (UID: \"8bae1a97-c19f-4ce0-bf23-fef3c604efd5\") " Jul 27 16:32:54.558994 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.558958 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle" (OuterVolumeSpecName: "bundle") pod "8bae1a97-c19f-4ce0-bf23-fef3c604efd5" (UID: "8bae1a97-c19f-4ce0-bf23-fef3c604efd5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:32:54.560741 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.560717 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz" (OuterVolumeSpecName: "kube-api-access-52gsz") pod "8bae1a97-c19f-4ce0-bf23-fef3c604efd5" (UID: "8bae1a97-c19f-4ce0-bf23-fef3c604efd5"). InnerVolumeSpecName "kube-api-access-52gsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:32:54.566413 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.566385 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util" (OuterVolumeSpecName: "util") pod "8bae1a97-c19f-4ce0-bf23-fef3c604efd5" (UID: "8bae1a97-c19f-4ce0-bf23-fef3c604efd5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 16:32:54.660109 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.660069 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-util\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:54.660109 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.660106 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52gsz\" (UniqueName: \"kubernetes.io/projected/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-kube-api-access-52gsz\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:54.660109 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:54.660116 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bae1a97-c19f-4ce0-bf23-fef3c604efd5-bundle\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:32:55.300947 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:55.300914 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" Jul 27 16:32:55.301120 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:55.300953 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78eg6jmm" event={"ID":"8bae1a97-c19f-4ce0-bf23-fef3c604efd5","Type":"ContainerDied","Data":"ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60"} Jul 27 16:32:55.301120 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:55.300997 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab918e15de091c1389cd3985d540a5ffa62b2175e8b4dc32eab0cd6c7d552a60" Jul 27 16:32:59.892661 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:59.892624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:32:59.993371 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:32:59.993335 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:01.167027 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.166987 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn"] Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167430 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="pull" Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167448 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="pull" Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167463 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="extract" Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167471 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="extract" Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167484 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="util" Jul 27 16:33:01.167528 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167492 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="util" Jul 27 16:33:01.167821 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.167576 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bae1a97-c19f-4ce0-bf23-fef3c604efd5" containerName="extract" Jul 27 16:33:01.170421 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.170397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.172830 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.172777 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 27 16:33:01.173432 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.173414 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-4dxj6\"" Jul 27 16:33:01.173932 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.173916 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 27 16:33:01.183858 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.183824 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn"] Jul 27 16:33:01.219439 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.219382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62758562-5518-4137-84ee-3badbf543760-tmp\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.219633 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.219477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmrs\" (UniqueName: \"kubernetes.io/projected/62758562-5518-4137-84ee-3badbf543760-kube-api-access-jrmrs\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.320789 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.320753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62758562-5518-4137-84ee-3badbf543760-tmp\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.320975 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.320814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmrs\" (UniqueName: \"kubernetes.io/projected/62758562-5518-4137-84ee-3badbf543760-kube-api-access-jrmrs\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.321157 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.321134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62758562-5518-4137-84ee-3badbf543760-tmp\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.329431 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.329403 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmrs\" (UniqueName: \"kubernetes.io/projected/62758562-5518-4137-84ee-3badbf543760-kube-api-access-jrmrs\") pod \"jobset-operator-5bc45f897-t5bcn\" (UID: \"62758562-5518-4137-84ee-3badbf543760\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.485968 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.485918 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" Jul 27 16:33:01.619635 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:01.619598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn"] Jul 27 16:33:01.622918 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:33:01.622890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62758562_5518_4137_84ee_3badbf543760.slice/crio-0d538ce7f2a2ac48dafc928a9d02383418e80c857dd4c52394f0cfa3e02c6163 WatchSource:0}: Error finding container 0d538ce7f2a2ac48dafc928a9d02383418e80c857dd4c52394f0cfa3e02c6163: Status 404 returned error can't find the container with id 0d538ce7f2a2ac48dafc928a9d02383418e80c857dd4c52394f0cfa3e02c6163 Jul 27 16:33:02.332435 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:02.332399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" event={"ID":"62758562-5518-4137-84ee-3badbf543760","Type":"ContainerStarted","Data":"0d538ce7f2a2ac48dafc928a9d02383418e80c857dd4c52394f0cfa3e02c6163"} Jul 27 16:33:05.349948 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:05.349908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" event={"ID":"62758562-5518-4137-84ee-3badbf543760","Type":"ContainerStarted","Data":"f8621ab41aed97d63ec1fedfb1d97fa0d7dfa3a1f3d662f6a384ee94a5d875ad"} Jul 27 16:33:05.397751 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:05.397690 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-t5bcn" podStartSLOduration=1.63954964 podStartE2EDuration="4.397672591s" totalImagesPullingTime="2.758122951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:33:05.395627673 +0000 UTC m=+530.428939278" watchObservedRunningTime="2026-07-27 16:33:05.397672591 +0000 UTC m=+530.430984196" Jul 27 16:33:10.211401 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:10.211315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:10.311959 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:10.311922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:10.413777 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:10.413742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:12.236352 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:12.236317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:20.514629 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:20.514592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:21.553765 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:21.553733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:21.656341 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:21.656298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:22.493623 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:22.493592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:22.585671 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:22.585633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:40.264826 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:40.264791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:40.364944 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:40.364907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:43.674397 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:43.674361 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:43.947408 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:43.947378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:44.048203 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:44.048174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:46.249484 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:46.249447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:46.313979 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:46.313947 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:48.713753 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:48.713717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:33:48.775342 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:33:48.775311 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:34:41.496856 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:34:41.496771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:35:09.490991 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:35:09.490951 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:35:09.587077 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:35:09.587044 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:35:09.666936 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:35:09.666906 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:36:19.793940 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:36:19.793901 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:36:26.681913 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:36:26.681865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:37:34.583885 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:37:34.583827 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:38:09.389014 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:09.388933 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:38:24.426141 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.426106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:38:24.429692 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.429666 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv"] Jul 27 16:38:24.432649 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.432632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:38:24.434605 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.434588 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"kube-root-ca.crt\"" Jul 27 16:38:24.434689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.434592 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-n94vk\"/\"openshift-service-ca.crt\"" Jul 27 16:38:24.434689 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.434592 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-n94vk\"/\"default-dockercfg-xv8jx\"" Jul 27 16:38:24.443529 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.443507 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv"] Jul 27 16:38:24.574865 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.574828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8l2\" (UniqueName: \"kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2\") pod \"progression-custom-config-node-0-0-v58fv\" (UID: \"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60\") " pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:38:24.676004 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.675953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8l2\" (UniqueName: \"kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2\") pod \"progression-custom-config-node-0-0-v58fv\" (UID: \"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60\") " pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:38:24.686182 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.686158 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8l2\" (UniqueName: \"kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2\") pod \"progression-custom-config-node-0-0-v58fv\" (UID: \"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60\") " pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:38:24.741209 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.741171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:38:24.876499 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.876455 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv"] Jul 27 16:38:24.879284 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:38:24.879256 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a9edf5_6a0d_4712_b05c_0ee7e0a38c60.slice/crio-019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba WatchSource:0}: Error finding container 019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba: Status 404 returned error can't find the container with id 019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba Jul 27 16:38:24.881363 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:24.881346 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 16:38:25.000781 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:25.000670 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:38:25.764555 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:38:25.764521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" event={"ID":"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60","Type":"ContainerStarted","Data":"019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba"} Jul 27 16:39:24.275509 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:39:24.275459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:39:24.336714 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:39:24.336675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:12.299858 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:12.299819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" event={"ID":"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60","Type":"ContainerStarted","Data":"f2e00c7d0945f5249e7ca7c94eea684d882f921015e231c843dab2acd94208dd"} Jul 27 16:40:12.300298 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:12.299906 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:40:12.324760 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:12.324699 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" podStartSLOduration=1.303057808 podStartE2EDuration="1m48.324679419s" totalImagesPullingTime="1m47.021621611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:40:12.323552861 +0000 UTC m=+957.356864470" watchObservedRunningTime="2026-07-27 16:40:12.324679419 +0000 UTC m=+957.357991026" Jul 27 16:40:13.301687 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:13.301646 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 27 16:40:13.308624 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:13.308590 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 27 16:40:14.309971 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:14.309942 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:40:25.026992 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:25.026962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:35.309605 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:35.309545 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": dial tcp 10.132.0.28:28080: connect: connection refused" Jul 27 16:40:35.409300 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:35.409270 2575 generic.go:356] "Generic (PLEG): container finished" podID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerID="f2e00c7d0945f5249e7ca7c94eea684d882f921015e231c843dab2acd94208dd" exitCode=0 Jul 27 16:40:35.409417 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:35.409345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" event={"ID":"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60","Type":"ContainerDied","Data":"f2e00c7d0945f5249e7ca7c94eea684d882f921015e231c843dab2acd94208dd"} Jul 27 16:40:36.562510 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:36.562485 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:40:36.635521 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:36.635482 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx8l2\" (UniqueName: \"kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2\") pod \"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60\" (UID: \"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60\") " Jul 27 16:40:36.637532 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:36.637510 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2" (OuterVolumeSpecName: "kube-api-access-hx8l2") pod "e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" (UID: "e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60"). InnerVolumeSpecName "kube-api-access-hx8l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 16:40:36.736568 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:36.736538 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx8l2\" (UniqueName: \"kubernetes.io/projected/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60-kube-api-access-hx8l2\") on node \"ip-10-0-128-172.ec2.internal\" DevicePath \"\"" Jul 27 16:40:36.992663 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:36.992585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:37.419596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:37.419491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" event={"ID":"e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60","Type":"ContainerDied","Data":"019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba"} Jul 27 16:40:37.419596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:37.419514 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv" Jul 27 16:40:37.419596 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:37.419538 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="019b55964c36a644c5a419f9f8de304957c7363b67d486851ca8b7ce2edeecba" Jul 27 16:40:37.565957 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:37.565923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:37.631127 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:37.631088 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:41.974401 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:41.974360 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv"] Jul 27 16:40:41.979699 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:41.979675 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-n94vk/progression-custom-config-node-0-0-v58fv"] Jul 27 16:40:42.179922 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:42.179885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:42.279839 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:42.279762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:42.986159 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:42.986125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:43.059769 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:43.059742 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:40:43.459765 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:40:43.459738 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" path="/var/lib/kubelet/pods/e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60/volumes" Jul 27 16:41:25.234507 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:25.234472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:34.154612 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.154575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:34.280660 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.280631 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wgg7p/must-gather-b29rt"] Jul 27 16:41:34.280951 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.280918 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" Jul 27 16:41:34.280951 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.280931 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" Jul 27 16:41:34.281039 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.280992 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a9edf5-6a0d-4712-b05c-0ee7e0a38c60" containerName="node" Jul 27 16:41:34.282967 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.282944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.284864 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.284838 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgg7p\"/\"kube-root-ca.crt\"" Jul 27 16:41:34.284966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.284899 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wgg7p\"/\"default-dockercfg-hjb57\"" Jul 27 16:41:34.284966 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.284949 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgg7p\"/\"openshift-service-ca.crt\"" Jul 27 16:41:34.292155 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.292133 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/must-gather-b29rt"] Jul 27 16:41:34.294651 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.294604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:34.395205 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.395175 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dd02ae3-4b92-4668-afff-e6e315e82664-must-gather-output\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.395359 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.395242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w2l\" (UniqueName: \"kubernetes.io/projected/3dd02ae3-4b92-4668-afff-e6e315e82664-kube-api-access-l8w2l\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.395948 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.395927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:34.495754 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.495726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w2l\" (UniqueName: \"kubernetes.io/projected/3dd02ae3-4b92-4668-afff-e6e315e82664-kube-api-access-l8w2l\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.495893 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.495799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dd02ae3-4b92-4668-afff-e6e315e82664-must-gather-output\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.496107 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.496088 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dd02ae3-4b92-4668-afff-e6e315e82664-must-gather-output\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.503598 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.503572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w2l\" (UniqueName: \"kubernetes.io/projected/3dd02ae3-4b92-4668-afff-e6e315e82664-kube-api-access-l8w2l\") pod \"must-gather-b29rt\" (UID: \"3dd02ae3-4b92-4668-afff-e6e315e82664\") " pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.592277 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.592217 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/must-gather-b29rt" Jul 27 16:41:34.723547 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:34.723516 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/must-gather-b29rt"] Jul 27 16:41:34.726601 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:41:34.726572 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dd02ae3_4b92_4668_afff_e6e315e82664.slice/crio-2a1110f1c3cd0659a807a3fa56765031c3f1fbaa7927f3e2aef88b1fa0983d26 WatchSource:0}: Error finding container 2a1110f1c3cd0659a807a3fa56765031c3f1fbaa7927f3e2aef88b1fa0983d26: Status 404 returned error can't find the container with id 2a1110f1c3cd0659a807a3fa56765031c3f1fbaa7927f3e2aef88b1fa0983d26 Jul 27 16:41:35.676700 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:35.676599 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/must-gather-b29rt" event={"ID":"3dd02ae3-4b92-4668-afff-e6e315e82664","Type":"ContainerStarted","Data":"5f6a93ba1b209090fc0f09e137640cb03006920ae5a031f58bd4aed12f79c3ec"} Jul 27 16:41:35.676700 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:35.676655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/must-gather-b29rt" event={"ID":"3dd02ae3-4b92-4668-afff-e6e315e82664","Type":"ContainerStarted","Data":"f6ba696d9598bb8c625fb597368ee035e43fd3697b67793a4133e459559e2eb3"} Jul 27 16:41:35.676700 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:35.676672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/must-gather-b29rt" event={"ID":"3dd02ae3-4b92-4668-afff-e6e315e82664","Type":"ContainerStarted","Data":"2a1110f1c3cd0659a807a3fa56765031c3f1fbaa7927f3e2aef88b1fa0983d26"} Jul 27 16:41:35.693371 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:35.693307 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wgg7p/must-gather-b29rt" podStartSLOduration=1.06094754 podStartE2EDuration="1.693286781s" totalImagesPullingTime="632.339241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:35.692399329 +0000 UTC m=+1040.725710936" watchObservedRunningTime="2026-07-27 16:41:35.693286781 +0000 UTC m=+1040.726598388" Jul 27 16:41:36.794711 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:36.794681 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j69dd_f1d75743-e1f4-4ec8-ab87-c9217b57fbe1/global-pull-secret-syncer/0.log" Jul 27 16:41:36.871456 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:36.871426 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" Jul 27 16:41:36.953734 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:36.953706 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-172.ec2.internal_5478dd9fd1b137f838abb934e41d00b1/haproxy/0.log" Jul 27 16:41:39.814587 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:39.814544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:39.903446 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:39.903412 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:41.413670 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.413637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-w8rqh_28ecb5fb-29b9-404b-811c-09c6122d80cf/cluster-monitoring-operator/0.log" Jul 27 16:41:41.438847 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.438818 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rv9fk_57a5a4a6-e219-45aa-bd7d-3b7755780436/kube-state-metrics/0.log" Jul 27 16:41:41.468721 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.468681 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rv9fk_57a5a4a6-e219-45aa-bd7d-3b7755780436/kube-rbac-proxy-main/0.log" Jul 27 16:41:41.494639 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.494607 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-rv9fk_57a5a4a6-e219-45aa-bd7d-3b7755780436/kube-rbac-proxy-self/0.log" Jul 27 16:41:41.531717 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.531674 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-797d4644dc-zzfcq_3ddb6873-fb03-4af7-b10b-2257de59bec1/metrics-server/0.log" Jul 27 16:41:41.565601 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.565543 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-jfxhd_9c0e94d7-f8b0-4dc8-b0fd-71b755bf3f2f/monitoring-plugin/0.log" Jul 27 16:41:41.807651 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.807596 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxnvr_b354d241-6dc4-486c-b5c6-5058cc932bb8/node-exporter/0.log" Jul 27 16:41:41.841530 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.841474 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxnvr_b354d241-6dc4-486c-b5c6-5058cc932bb8/kube-rbac-proxy/0.log" Jul 27 16:41:41.868070 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.868019 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sxnvr_b354d241-6dc4-486c-b5c6-5058cc932bb8/init-textfile/0.log" Jul 27 16:41:41.906513 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.906484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wkd62_cefe8a3e-89ef-4681-88cf-da3ed1f42ad7/kube-rbac-proxy-main/0.log" Jul 27 16:41:41.935548 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.935523 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wkd62_cefe8a3e-89ef-4681-88cf-da3ed1f42ad7/kube-rbac-proxy-self/0.log" Jul 27 16:41:41.968954 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:41.968928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-wkd62_cefe8a3e-89ef-4681-88cf-da3ed1f42ad7/openshift-state-metrics/0.log" Jul 27 16:41:42.252615 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.252577 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zq7lx_5befcb9e-ee78-4bdb-bbb5-5201e5013c6a/prometheus-operator/0.log" Jul 27 16:41:42.275170 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.275143 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zq7lx_5befcb9e-ee78-4bdb-bbb5-5201e5013c6a/kube-rbac-proxy/0.log" Jul 27 16:41:42.351259 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.351232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dff9dbb-blh2k_5ad22227-f26d-49f3-82ab-f92d5511f4e3/telemeter-client/0.log" Jul 27 16:41:42.377455 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.377424 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dff9dbb-blh2k_5ad22227-f26d-49f3-82ab-f92d5511f4e3/reload/0.log" Jul 27 16:41:42.400406 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.400380 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54dff9dbb-blh2k_5ad22227-f26d-49f3-82ab-f92d5511f4e3/kube-rbac-proxy/0.log" Jul 27 16:41:42.741644 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:42.741608 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mgsgk_9363e8f6-7788-4d4f-91cb-f04458c9e760/konnectivity-agent/0.log" limit=1024 Jul 27 16:41:43.562600 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.562571 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-s9vbw_8edff5fd-1054-4406-9015-36f9e28f7382/networking-console-plugin/0.log" Jul 27 16:41:43.863899 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.863815 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg"] Jul 27 16:41:43.868337 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.868306 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:43.877075 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.877045 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg"] Jul 27 16:41:43.980937 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.980904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-podres\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:43.981090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.980946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscjk\" (UniqueName: \"kubernetes.io/projected/cf42adc9-12a2-4844-9ad5-29a5a6521890-kube-api-access-bscjk\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:43.981090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.980975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-proc\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:43.981090 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.981072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-lib-modules\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:43.981193 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:43.981126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-sys\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.081825 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.081785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-lib-modules\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082016 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.081844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-sys\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082016 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.081917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-podres\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082016 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.081948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-lib-modules\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082016 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.081948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscjk\" (UniqueName: \"kubernetes.io/projected/cf42adc9-12a2-4844-9ad5-29a5a6521890-kube-api-access-bscjk\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082016 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.082001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-proc\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082317 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.082086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-proc\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082317 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.082133 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-sys\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.082317 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.082238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf42adc9-12a2-4844-9ad5-29a5a6521890-podres\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.091184 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.090551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscjk\" (UniqueName: \"kubernetes.io/projected/cf42adc9-12a2-4844-9ad5-29a5a6521890-kube-api-access-bscjk\") pod \"perf-node-gather-daemonset-fl6dg\" (UID: \"cf42adc9-12a2-4844-9ad5-29a5a6521890\") " pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.181475 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.181435 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.344029 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.343982 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg"] Jul 27 16:41:44.347190 ip-10-0-128-172 kubenswrapper[2575]: W0727 16:41:44.347157 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf42adc9_12a2_4844_9ad5_29a5a6521890.slice/crio-511749100a203a0caced0a551504e609567f0196f2521d7f585a55f0dbfc0231 WatchSource:0}: Error finding container 511749100a203a0caced0a551504e609567f0196f2521d7f585a55f0dbfc0231: Status 404 returned error can't find the container with id 511749100a203a0caced0a551504e609567f0196f2521d7f585a55f0dbfc0231 Jul 27 16:41:44.735009 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.734918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" event={"ID":"cf42adc9-12a2-4844-9ad5-29a5a6521890","Type":"ContainerStarted","Data":"fdb3126a5d103c8c8fa77bc495af48287fc683c8a9d567c53d4f2bef387f7d17"} Jul 27 16:41:44.735009 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.734993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" event={"ID":"cf42adc9-12a2-4844-9ad5-29a5a6521890","Type":"ContainerStarted","Data":"511749100a203a0caced0a551504e609567f0196f2521d7f585a55f0dbfc0231"} Jul 27 16:41:44.735284 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.735263 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:44.752598 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.752543 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" podStartSLOduration=1.752528033 podStartE2EDuration="1.752528033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:44.751430075 +0000 UTC m=+1049.784741692" watchObservedRunningTime="2026-07-27 16:41:44.752528033 +0000 UTC m=+1049.785839639" Jul 27 16:41:44.994961 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:44.994886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-fg8zj_9722f74d-73ef-4f1e-8bd7-ff2e695e09d3/volume-data-source-validator/0.log" Jul 27 16:41:45.795512 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:45.795478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mx274_82db6950-00b0-484f-9f7b-d8b12cd439cc/dns/0.log" Jul 27 16:41:45.820729 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:45.820702 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mx274_82db6950-00b0-484f-9f7b-d8b12cd439cc/kube-rbac-proxy/0.log" Jul 27 16:41:45.995713 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:45.995682 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lptsj_b0d5637d-0f66-47f6-bc31-67c73cd78b4c/dns-node-resolver/0.log" Jul 27 16:41:46.512431 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:46.512409 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfwbd_eccc9870-4298-46a4-b6dd-240a2f583e46/node-ca/0.log" Jul 27 16:41:47.260339 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:47.260305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cbfd4d8d9-sqnwx_1805f4e9-6308-47e7-b140-8e31fabd07b5/router/0.log" Jul 27 16:41:47.655799 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:47.655726 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbr49_55f68011-1582-411b-afa5-862e9ab575f8/serve-healthcheck-canary/0.log" Jul 27 16:41:48.123956 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:48.123926 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vhvk6_749bcdf9-8c7b-44ab-a96c-a3a46a2164bc/kube-rbac-proxy/0.log" Jul 27 16:41:48.144998 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:48.144974 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vhvk6_749bcdf9-8c7b-44ab-a96c-a3a46a2164bc/exporter/0.log" Jul 27 16:41:48.165563 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:48.165543 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vhvk6_749bcdf9-8c7b-44ab-a96c-a3a46a2164bc/extractor/0.log" Jul 27 16:41:49.954333 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:49.954304 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-t5bcn_62758562-5518-4137-84ee-3badbf543760/jobset-operator/0.log" Jul 27 16:41:50.753337 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:50.753307 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wgg7p/perf-node-gather-daemonset-fl6dg" Jul 27 16:41:53.868702 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:53.868672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz_921f1436-e1f0-499e-b580-02b6a6b07916/kube-storage-version-migrator-operator/1.log" Jul 27 16:41:53.869591 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:53.869563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-q2whz_921f1436-e1f0-499e-b580-02b6a6b07916/kube-storage-version-migrator-operator/0.log" Jul 27 16:41:55.000216 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.000184 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/kube-multus-additional-cni-plugins/0.log" Jul 27 16:41:55.023284 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.023257 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/egress-router-binary-copy/0.log" Jul 27 16:41:55.046062 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.046040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/cni-plugins/0.log" Jul 27 16:41:55.068828 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.068775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/bond-cni-plugin/0.log" Jul 27 16:41:55.095660 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.095633 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/routeoverride-cni/0.log" Jul 27 16:41:55.118674 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.118646 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/whereabouts-cni-bincopy/0.log" Jul 27 16:41:55.143525 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.143502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hwmt6_195be682-e8bc-4574-8db4-e87bcd9436f5/whereabouts-cni/0.log" Jul 27 16:41:55.437025 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.436995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sm72l_f7d0e52b-0332-437c-af6d-4c3b8eca48b7/kube-multus/0.log" Jul 27 16:41:55.461126 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.461100 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-56rvn_57d428b4-7cd5-45ce-b0d5-e84f2fa56d23/network-metrics-daemon/0.log" Jul 27 16:41:55.484531 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:55.484510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-56rvn_57d428b4-7cd5-45ce-b0d5-e84f2fa56d23/kube-rbac-proxy/0.log" Jul 27 16:41:56.741466 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.741429 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/ovn-controller/0.log" Jul 27 16:41:56.769716 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.769690 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/ovn-acl-logging/0.log" Jul 27 16:41:56.797453 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.797433 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/kube-rbac-proxy-node/0.log" Jul 27 16:41:56.822489 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.822467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 16:41:56.844198 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.844167 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/northd/0.log" Jul 27 16:41:56.871512 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.871492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/nbdb/0.log" Jul 27 16:41:56.894722 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.894701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/sbdb/0.log" Jul 27 16:41:56.941443 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:56.941418 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-knsrr_7a781d7c-2868-4b94-b094-253a1ed517cc/ovnkube-controller/0.log" Jul 27 16:41:58.239681 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:58.239656 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9bkmb_35b09e63-2204-4fd9-9ad3-9818b4524f55/network-check-target-container/0.log" Jul 27 16:41:59.123777 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:59.123752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kjmms_4c56d98b-7209-4213-a92b-05df304efbff/iptables-alerter/0.log" Jul 27 16:41:59.812319 ip-10-0-128-172 kubenswrapper[2575]: I0727 16:41:59.812286 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-25wn9_8923ee9e-642d-494e-8c60-3ef268841a09/tuned/0.log"