Jul 28 17:09:26.656402 ip-10-0-139-137 systemd[1]: Starting Kubernetes Kubelet... Jul 28 17:09:27.061779 ip-10-0-139-137 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:27.061779 ip-10-0-139-137 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 17:09:27.061779 ip-10-0-139-137 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:27.061779 ip-10-0-139-137 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 17:09:27.061779 ip-10-0-139-137 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 17:09:27.062523 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.061864 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071558 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071587 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071591 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071595 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071598 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071602 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071605 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.071595 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071608 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071611 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071615 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071617 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071623 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071627 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071630 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071633 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071636 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071639 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071642 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071645 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071648 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071650 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071653 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071656 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071659 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071662 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071664 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071667 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.071911 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071669 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071673 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071677 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071681 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071686 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071689 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071692 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071694 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071696 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071699 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071701 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071704 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071706 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071709 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071713 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071715 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071718 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071720 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071723 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.072420 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071725 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071730 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071734 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071737 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071740 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071744 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071747 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071750 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071753 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071756 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071758 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071761 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071763 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071766 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071769 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071772 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071775 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071778 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071781 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.072894 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071783 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071786 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071788 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071791 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071794 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071796 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071799 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071802 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071805 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071807 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071810 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071813 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071815 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071818 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071820 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071823 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071826 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071828 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071837 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071840 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.073382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071842 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071845 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071847 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071851 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071853 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071855 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071858 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071860 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071863 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071865 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071867 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071870 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071872 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.071875 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072623 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072629 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072632 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072634 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072638 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072640 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.073913 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072644 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072647 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072650 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072653 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072655 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072658 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072661 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072664 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072666 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072669 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072672 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072675 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072678 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072682 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072686 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072688 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072691 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072694 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072696 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.074413 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072699 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072701 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072704 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072706 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072709 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072711 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072714 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072716 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072719 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072721 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072724 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072726 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072729 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072732 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072734 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072737 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072740 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072742 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072744 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072747 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.074886 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072749 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072752 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072754 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072757 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072759 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072764 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072766 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072769 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072771 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072774 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072776 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072778 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072781 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072784 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072786 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072788 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072791 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072794 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072796 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.075397 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072801 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072804 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072806 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072809 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072812 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072815 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072821 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072825 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072828 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072831 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072833 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072836 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072838 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072841 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072844 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072846 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072849 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072851 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072854 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072860 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.075867 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072863 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072865 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072868 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072870 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072873 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072876 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072878 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072882 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072886 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072889 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072892 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072894 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072897 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072900 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.072902 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073324 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073329 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073332 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073336 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073339 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.076382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073342 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073344 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073347 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073349 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073352 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073355 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073357 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073360 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073362 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073364 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073367 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073371 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073373 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073383 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073388 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073391 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073393 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073396 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073399 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.076882 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073402 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073404 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073407 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073410 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073413 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073415 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073418 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073420 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073423 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073426 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073429 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073433 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073436 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073439 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073441 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073444 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073447 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073451 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073455 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.077354 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073458 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073461 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073464 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073467 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073470 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073473 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073477 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073481 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073483 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073486 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073488 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073491 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073493 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073496 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073498 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073503 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073505 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073508 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073510 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073513 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.077823 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073515 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073518 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073520 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073523 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073527 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073529 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073532 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073534 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073537 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073539 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073542 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073546 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073550 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073554 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073558 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073562 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073564 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073567 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073570 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.078335 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073573 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073576 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073578 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073581 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073583 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073585 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073588 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073590 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073593 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073595 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073598 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073600 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073602 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073605 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073607 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073610 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.073616 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073693 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073701 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073708 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073712 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 17:09:27.078836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073717 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073721 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073725 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073729 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073732 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073735 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073739 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073742 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073745 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073748 2578 flags.go:64] FLAG: --cgroup-root="" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073751 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073754 2578 flags.go:64] FLAG: --client-ca-file="" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073758 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073761 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073766 2578 flags.go:64] FLAG: --cluster-domain="" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073769 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073772 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073775 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073779 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073782 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073785 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073788 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073792 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073795 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 28 17:09:27.079354 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073798 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073801 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073804 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073809 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073815 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073818 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073821 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073824 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073827 2578 flags.go:64] FLAG: --enable-server="true" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073830 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073834 2578 flags.go:64] FLAG: --event-burst="100" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073837 2578 flags.go:64] FLAG: --event-qps="50" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073840 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073843 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073846 2578 flags.go:64] FLAG: --eviction-hard="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073850 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073853 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073856 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073859 2578 flags.go:64] FLAG: --eviction-soft="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073861 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073864 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073868 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073871 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073874 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073877 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 17:09:27.079930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073879 2578 flags.go:64] FLAG: --feature-gates="" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073883 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073886 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073889 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073892 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073895 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073898 2578 flags.go:64] FLAG: --help="false" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073901 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073904 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073906 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073911 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073916 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073919 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073923 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073926 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073929 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073932 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073934 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073937 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073940 2578 flags.go:64] FLAG: --kube-reserved="" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073943 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073946 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073949 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073952 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 17:09:27.080568 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073955 2578 flags.go:64] FLAG: --lock-file="" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073958 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073960 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073963 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073968 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073972 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073975 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073977 2578 flags.go:64] FLAG: --logging-format="text" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073980 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073984 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073987 2578 flags.go:64] FLAG: --manifest-url="" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073989 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073993 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.073996 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074001 2578 flags.go:64] FLAG: --max-pods="110" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074004 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074007 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074010 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074013 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074017 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074020 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074023 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074031 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074034 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074037 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 17:09:27.081581 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074039 2578 flags.go:64] FLAG: --pod-cidr="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074042 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074048 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074050 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074053 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074056 2578 flags.go:64] FLAG: --port="10250" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074059 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074062 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06cb88d74e8e91186" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074065 2578 flags.go:64] FLAG: --qos-reserved="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074067 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074070 2578 flags.go:64] FLAG: --register-node="true" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074073 2578 flags.go:64] FLAG: --register-with-taints="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074076 2578 flags.go:64] FLAG: --registry-burst="10" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074080 2578 flags.go:64] FLAG: --registry-qps="5" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074083 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074086 2578 flags.go:64] FLAG: --reserved-memory="" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074089 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074092 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074095 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074098 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074100 2578 flags.go:64] FLAG: --runonce="false" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074103 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074106 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074110 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074112 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 17:09:27.082660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074116 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074119 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074122 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074125 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074128 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074144 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074147 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074150 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074154 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074157 2578 flags.go:64] FLAG: --system-cgroups="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074160 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074165 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074168 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074171 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074176 2578 flags.go:64] FLAG: --tls-min-version="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074179 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074181 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074184 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074187 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074190 2578 flags.go:64] FLAG: --v="2" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074195 2578 flags.go:64] FLAG: --version="false" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074200 2578 flags.go:64] FLAG: --vmodule="" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074204 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.074207 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074330 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.083797 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074334 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074337 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074339 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074342 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074347 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074350 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074353 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074356 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074359 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074362 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074365 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074368 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074370 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074373 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074376 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074378 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074381 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074383 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074386 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.084915 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074388 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074391 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074394 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074396 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074399 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074401 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074404 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074406 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074409 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074412 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074426 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074429 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074432 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074434 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074437 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074439 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074441 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074444 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074446 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.085645 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074449 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074452 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074454 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074460 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074462 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074465 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074467 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074470 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074473 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074475 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074478 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074481 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074506 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074509 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074513 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074516 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074519 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074522 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074525 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.086282 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074528 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074531 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074534 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074537 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074540 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074543 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074546 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074548 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074551 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074554 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074556 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074559 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074561 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074565 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074568 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074572 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074575 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074578 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074581 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074583 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.087119 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074586 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074588 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074591 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074595 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074598 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074601 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074604 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074607 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074610 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074613 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074615 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074618 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074621 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074623 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074626 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074629 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074631 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074634 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074637 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.087851 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.074639 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.075633 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.083746 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.083772 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.083799 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.083808 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083903 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083911 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083917 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083922 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083926 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083931 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083935 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083939 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.088400 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083944 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083951 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083957 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083962 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083967 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083972 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083976 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083980 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083985 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083989 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083993 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.083997 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084001 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084006 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084010 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084014 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084018 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084023 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084027 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084031 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.088842 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084035 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084049 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084054 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084058 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084063 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084067 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084071 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084075 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084079 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084083 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084088 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084092 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084096 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084101 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084105 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084109 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084113 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084118 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084122 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084126 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.089459 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084130 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084152 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084158 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084167 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084172 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084176 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084180 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084184 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084188 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084192 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084196 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084200 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084205 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084220 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084225 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084229 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084233 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084237 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084242 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.089953 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084246 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084250 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084254 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084259 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084263 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084268 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084272 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084276 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084280 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084284 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084289 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084293 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084298 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084302 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084307 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084311 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084315 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084320 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084324 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084329 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.090527 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084333 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084338 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084342 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084348 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084354 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084360 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084364 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084377 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084383 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084387 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084391 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.084400 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084651 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084660 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 17:09:27.091014 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084665 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084669 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084675 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084679 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084683 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084688 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084692 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084696 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084700 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084705 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084710 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084714 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084720 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084726 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084731 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084735 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084742 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084747 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 17:09:27.091382 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084752 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084757 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084762 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084767 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084771 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084775 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084779 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084783 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084796 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084801 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084805 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084810 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084814 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084818 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084822 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084826 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084831 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084834 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084838 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084843 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 17:09:27.091819 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084847 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084851 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084855 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084859 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084863 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084867 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084871 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084875 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084880 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084884 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084888 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084892 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084896 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084900 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084904 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084909 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084913 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084916 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084921 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084924 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 17:09:27.092315 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084928 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084943 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084948 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084954 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084960 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084964 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084969 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084974 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084978 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084982 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084986 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084990 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084994 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.084999 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085003 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085007 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085011 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085015 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085024 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 17:09:27.092801 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085028 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085033 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085038 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085042 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085046 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085050 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085054 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085058 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085062 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085067 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085073 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085077 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085081 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085086 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085098 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085102 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085106 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085110 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 17:09:27.093408 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:27.085114 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.085123 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.085342 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.088374 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.090324 2578 server.go:1019] "Starting client certificate rotation" Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.090427 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:09:27.093847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.090461 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 17:09:27.096192 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.096174 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:09:27.100040 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.100016 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 17:09:27.112939 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.112918 2578 log.go:25] "Validated CRI v1 runtime API" Jul 28 17:09:27.115112 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.115096 2578 log.go:25] "Validated CRI v1 image API" Jul 28 17:09:27.115959 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.115943 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 17:09:27.118832 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.118810 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 f1cc72e4-cf4c-47bb-838f-d5b1e40898dc:/dev/nvme0n1p4 fc595a05-bedf-4f60-8749-f16d1b315b3f:/dev/nvme0n1p3] Jul 28 17:09:27.118926 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.118831 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 17:09:27.122862 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.122841 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:09:27.124269 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.124157 2578 manager.go:216] Machine: {Timestamp:2026-07-28 17:09:27.122601171 +0000 UTC m=+0.353194199 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089234 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec288155efa9a6a4826d7c6d744b134d SystemUUID:ec288155-efa9-a6a4-826d-7c6d744b134d BootID:d1a09893-2300-42be-a2a1-d6fc778d549b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:d7:30:c6:1b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:d7:30:c6:1b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:89:f5:70:29:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 17:09:27.124269 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.124265 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 17:09:27.124410 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.124380 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 17:09:27.127484 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.127453 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 17:09:27.127675 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.127488 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 17:09:27.128189 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.128176 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 17:09:27.128244 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.128194 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 17:09:27.128244 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.128205 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:09:27.128947 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.128935 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 17:09:27.129741 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.129728 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 17:09:27.131523 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131510 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:09:27.131663 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131652 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 17:09:27.131724 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131689 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 28 17:09:27.131724 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131705 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 17:09:27.131811 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131727 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 17:09:27.131811 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131742 2578 kubelet.go:398] "Adding apiserver pod source" Jul 28 17:09:27.131811 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.131765 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 17:09:27.132369 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.132355 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:09:27.132445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.132378 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 17:09:27.134274 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.134260 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 17:09:27.136046 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.136034 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 17:09:27.136087 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.136063 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 17:09:27.137835 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137821 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137840 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137847 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137854 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137863 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137876 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137889 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137894 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137903 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137909 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 17:09:27.137913 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137917 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 17:09:27.138204 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.137924 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 17:09:27.138603 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.138586 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 17:09:27.138674 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.138664 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 17:09:27.141576 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.141550 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 17:09:27.141653 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.141553 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 17:09:27.142058 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.142047 2578 server.go:1268] "Started kubelet" Jul 28 17:09:27.142176 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.142147 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 17:09:27.142263 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.142169 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 17:09:27.142263 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.142239 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 17:09:27.142947 ip-10-0-139-137 systemd[1]: Started Kubernetes Kubelet. Jul 28 17:09:27.143849 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.143806 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 17:09:27.144088 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.144073 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 17:09:27.144714 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.144695 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 28 17:09:27.148761 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.148740 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 17:09:27.149215 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.149202 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zp4ql" Jul 28 17:09:27.151880 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.151863 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 17:09:27.151880 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.151867 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 17:09:27.152549 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.152034 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.152754 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.150971 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-137.ec2.internal.18c6833546b91148 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-137.ec2.internal,UID:ip-10-0-139-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-137.ec2.internal,},FirstTimestamp:2026-07-28 17:09:27.1420194 +0000 UTC m=+0.372612429,LastTimestamp:2026-07-28 17:09:27.1420194 +0000 UTC m=+0.372612429,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-137.ec2.internal,}" Jul 28 17:09:27.152851 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.152759 2578 factory.go:55] Registering systemd factory Jul 28 17:09:27.152851 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.152775 2578 factory.go:223] Registration of the systemd container factory successfully Jul 28 17:09:27.152959 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.152864 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 17:09:27.152959 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.152877 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 17:09:27.152959 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.152954 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 17:09:27.153091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153016 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 28 17:09:27.153091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153025 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 28 17:09:27.153213 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153109 2578 factory.go:153] Registering CRI-O factory Jul 28 17:09:27.153213 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153126 2578 factory.go:223] Registration of the crio container factory successfully Jul 28 17:09:27.153213 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153204 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 17:09:27.153350 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153224 2578 factory.go:103] Registering Raw factory Jul 28 17:09:27.153350 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153241 2578 manager.go:1196] Started watching for new ooms in manager Jul 28 17:09:27.153689 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.153673 2578 manager.go:349] Starting recovery of all containers Jul 28 17:09:27.154794 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.154760 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 17:09:27.154886 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.154835 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 17:09:27.155267 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.155247 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zp4ql" Jul 28 17:09:27.160598 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.160563 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 17:09:27.168267 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.168089 2578 manager.go:354] Recovery completed Jul 28 17:09:27.172706 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.172693 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.178229 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178208 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.178302 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178242 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.178302 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178252 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.178776 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178763 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 17:09:27.178776 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178776 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 17:09:27.178869 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178778 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.178869 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.178792 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 28 17:09:27.179522 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.179507 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.179580 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.179536 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.179580 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.179545 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.180459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.180448 2578 policy_none.go:49] "None policy: Start" Jul 28 17:09:27.180493 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.180464 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 17:09:27.180493 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.180474 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 17:09:27.181500 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.181490 2578 policy_none.go:47] "Start" Jul 28 17:09:27.215734 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.215720 2578 manager.go:337] "Starting Device Plugin manager" Jul 28 17:09:27.215833 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.215748 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 17:09:27.215833 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.215759 2578 server.go:87] "Starting device plugin registration server" Jul 28 17:09:27.216025 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.216013 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 17:09:27.216069 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.216028 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 17:09:27.216152 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.216117 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 17:09:27.216380 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.216229 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 17:09:27.216380 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.216242 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 17:09:27.216722 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.216703 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 17:09:27.216799 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.216776 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.316511 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.316485 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.317580 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.317620 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.317637 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.317672 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.326945 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.327875 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.326969 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-137.ec2.internal\": node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.343812 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.343785 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.391813 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.391779 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 17:09:27.391977 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.391827 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 17:09:27.391977 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.391851 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 17:09:27.391977 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.391892 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 17:09:27.394272 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.394244 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:27.447350 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.447302 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.494346 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.494313 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal"] Jul 28 17:09:27.494424 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.494411 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.496346 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.496324 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.496412 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.496361 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.496412 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.496374 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.497805 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.497792 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.497925 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.497909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.497993 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.497943 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.498926 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.498907 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.499028 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.498937 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.499028 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.498947 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.499028 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.498906 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.499028 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.499009 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.499028 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.499023 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.500374 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.500358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.500461 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.500384 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 17:09:27.501292 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.501275 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientMemory" Jul 28 17:09:27.501390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.501301 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 17:09:27.501390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.501316 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeHasSufficientPID" Jul 28 17:09:27.521868 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.521841 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-137.ec2.internal\" not found" node="ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.525488 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.525468 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-137.ec2.internal\" not found" node="ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.548511 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.548487 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.555367 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.555342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.555452 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.555371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.555452 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.555397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1def7bac9bf493198849b5b9d9d19c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-137.ec2.internal\" (UID: \"d1def7bac9bf493198849b5b9d9d19c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.648896 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.648860 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.655644 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.655724 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.655724 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1def7bac9bf493198849b5b9d9d19c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-137.ec2.internal\" (UID: \"d1def7bac9bf493198849b5b9d9d19c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.655800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.655800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655747 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1def7bac9bf493198849b5b9d9d19c5-config\") pod \"kube-apiserver-proxy-ip-10-0-139-137.ec2.internal\" (UID: \"d1def7bac9bf493198849b5b9d9d19c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.655800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.655751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4f32b0fa224625ab6dea697da8ecf54-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal\" (UID: \"f4f32b0fa224625ab6dea697da8ecf54\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.750470 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.750440 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.830086 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.830059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.830276 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.830118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:27.851129 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.851105 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.956351 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:27.956221 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:27.989594 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:27.989571 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:28.056865 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:28.056824 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:28.089679 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.089656 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 17:09:28.090270 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.089823 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:09:28.090270 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.089849 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 17:09:28.157400 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:28.157371 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:28.162327 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.162297 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:04:27 +0000 UTC" deadline="2028-03-21 19:32:17.501452449 +0000 UTC" Jul 28 17:09:28.162390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.162329 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14450h22m49.33912838s" Jul 28 17:09:28.257978 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:28.257955 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-137.ec2.internal\" not found" Jul 28 17:09:28.325836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.325806 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:28.346855 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:28.346820 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f32b0fa224625ab6dea697da8ecf54.slice/crio-b3fcd0c8030b80ef144da7a55c7375b09a75152b94c1814314206a66a2794558 WatchSource:0}: Error finding container b3fcd0c8030b80ef144da7a55c7375b09a75152b94c1814314206a66a2794558: Status 404 returned error can't find the container with id b3fcd0c8030b80ef144da7a55c7375b09a75152b94c1814314206a66a2794558 Jul 28 17:09:28.352042 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.352025 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" Jul 28 17:09:28.352816 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.352799 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:09:28.362536 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.362519 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:09:28.364608 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.364591 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" Jul 28 17:09:28.375025 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.375006 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 17:09:28.395666 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.395623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" event={"ID":"f4f32b0fa224625ab6dea697da8ecf54","Type":"ContainerStarted","Data":"b3fcd0c8030b80ef144da7a55c7375b09a75152b94c1814314206a66a2794558"} Jul 28 17:09:28.448167 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:28.448131 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1def7bac9bf493198849b5b9d9d19c5.slice/crio-e65d61aaf78e8a2ac05faf951ea7318cae012cd7ebadd71a1858346ba14a2bb2 WatchSource:0}: Error finding container e65d61aaf78e8a2ac05faf951ea7318cae012cd7ebadd71a1858346ba14a2bb2: Status 404 returned error can't find the container with id e65d61aaf78e8a2ac05faf951ea7318cae012cd7ebadd71a1858346ba14a2bb2 Jul 28 17:09:28.565384 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:28.565300 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:29.134685 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.134649 2578 apiserver.go:52] "Watching apiserver" Jul 28 17:09:29.146637 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.146601 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 17:09:29.147929 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.147899 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd","openshift-dns/node-resolver-v5hvm","openshift-multus/multus-additional-cni-plugins-9n74f","openshift-network-diagnostics/network-check-target-5p6p7","openshift-ovn-kubernetes/ovnkube-node-nvf9w","openshift-cluster-node-tuning-operator/tuned-rzn7b","openshift-image-registry/node-ca-mlw78","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal","openshift-multus/multus-d54wp","openshift-multus/network-metrics-daemon-xwqnb","openshift-network-operator/iptables-alerter-kb448","kube-system/global-pull-secret-syncer-mh8sc","kube-system/konnectivity-agent-brzzl","kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal"] Jul 28 17:09:29.149881 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.149847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.151165 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.151128 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.152486 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.152464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.152927 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.152677 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.152927 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.152703 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7n8hl\"" Jul 28 17:09:29.152927 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.152811 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 17:09:29.153177 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.152853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 17:09:29.153177 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.153055 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.153523 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.153508 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glp7v\"" Jul 28 17:09:29.153751 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.153729 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 17:09:29.153847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.153831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 17:09:29.154314 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.154293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:29.154410 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.154385 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:29.155299 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155264 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 17:09:29.155299 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155285 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 17:09:29.155984 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155678 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pzmm8\"" Jul 28 17:09:29.155984 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155773 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.155984 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.155984 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.155779 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 17:09:29.156259 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.156174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.157658 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.157621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159161 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159311 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159432 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.159808 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.159650 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 17:09:29.160173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.160024 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 17:09:29.160173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.160061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-njvj2\"" Jul 28 17:09:29.160345 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.160313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.160345 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.160340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g64rv\"" Jul 28 17:09:29.160564 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.160548 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.161381 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.161358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.162860 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.162623 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 17:09:29.162860 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.162720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4q7f4\"" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e818681-cf9b-4524-baa8-ec22c1932954-konnectivity-ca\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx55w\" (UniqueName: \"kubernetes.io/projected/3a7b7404-0732-4571-88aa-d47a794ff392-kube-api-access-qx55w\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a7b7404-0732-4571-88aa-d47a794ff392-serviceca\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-system-cni-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.163985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-os-release\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgnb\" (UniqueName: \"kubernetes.io/projected/593a8963-dd81-4653-8b79-1f4769b6e1ef-kube-api-access-xcgnb\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164055 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e818681-cf9b-4524-baa8-ec22c1932954-agent-certs\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-cnibin\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.164289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.164195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a7b7404-0732-4571-88aa-d47a794ff392-host\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.165739 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.165716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 17:09:29.166250 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.165841 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 17:09:29.166250 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.166250 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.166202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:29.166250 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.166501 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.166501 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166397 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.166501 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166470 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pt99j\"" Jul 28 17:09:29.166658 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lzdzb\"" Jul 28 17:09:29.166658 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.166572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.167719 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.167701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.169315 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.169299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.169402 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.169354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:29.170347 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.170322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 17:09:29.170442 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.170322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 17:09:29.170442 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.170373 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jch8b\"" Jul 28 17:09:29.170442 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.170332 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 17:09:29.191134 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.191110 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rj47t" Jul 28 17:09:29.198785 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.198757 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rj47t" Jul 28 17:09:29.253945 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.253911 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 17:09:29.265287 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-netd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.265459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.265459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-sys\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.265459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jf7v\" (UniqueName: \"kubernetes.io/projected/a79f93a6-24d2-4367-bbd0-63ebadac002b-kube-api-access-2jf7v\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.265459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-os-release\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.265459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.265732 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e818681-cf9b-4524-baa8-ec22c1932954-agent-certs\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.265732 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265570 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.265732 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-systemd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.265732 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-bin\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.265732 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-socket-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-hostroot\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e818681-cf9b-4524-baa8-ec22c1932954-konnectivity-ca\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-device-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-cni-binary-copy\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-netns\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-kubelet\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a7b7404-0732-4571-88aa-d47a794ff392-serviceca\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-config\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.265988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.265984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-modprobe-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgnb\" (UniqueName: \"kubernetes.io/projected/593a8963-dd81-4653-8b79-1f4769b6e1ef-kube-api-access-xcgnb\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-slash\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-netns\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-node-log\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovn-node-metrics-cert\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-systemd\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmrp\" (UniqueName: \"kubernetes.io/projected/ae967b17-a854-48df-9078-e84ba362146e-kube-api-access-ftmrp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-system-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.266465 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-multus-certs\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-conf\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zsf5\" (UniqueName: \"kubernetes.io/projected/c9d07d5e-697e-4ea7-8152-71f3f809d854-kube-api-access-4zsf5\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a79f93a6-24d2-4367-bbd0-63ebadac002b-host-slash\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-multus-daemon-config\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrtz8\" (UniqueName: \"kubernetes.io/projected/0d2fe370-6ed4-4801-83f5-db007534479e-kube-api-access-mrtz8\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-kubelet-config\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-dbus\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266786 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-etc-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-tmp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-sys-fs\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-cnibin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-var-lib-kubelet\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-multus\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-cnibin\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.266994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a7b7404-0732-4571-88aa-d47a794ff392-host\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.267159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqhl\" (UniqueName: \"kubernetes.io/projected/513fe9da-3496-4316-88db-9e0c135259e3-kube-api-access-4gqhl\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a79f93a6-24d2-4367-bbd0-63ebadac002b-iptables-alerter-script\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-bin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-etc-kubernetes\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267176 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-script-lib\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpz8\" (UniqueName: \"kubernetes.io/projected/d396dde0-7e09-4fd7-a1b6-de7026b3e986-kube-api-access-2qpz8\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-systemd-units\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-ovn\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-etc-tuned\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-host\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-socket-dir-parent\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749cr\" (UniqueName: \"kubernetes.io/projected/b911fba1-47dc-41b3-b599-c691b72732ab-kube-api-access-749cr\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-log-socket\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-run\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268065 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-k8s-cni-cncf-io\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx55w\" (UniqueName: \"kubernetes.io/projected/3a7b7404-0732-4571-88aa-d47a794ff392-kube-api-access-qx55w\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-kubelet\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysconfig\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-kubernetes\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9d07d5e-697e-4ea7-8152-71f3f809d854-hosts-file\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d07d5e-697e-4ea7-8152-71f3f809d854-tmp-dir\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-var-lib-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.267988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-env-overrides\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-lib-modules\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-registration-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-conf-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-system-cni-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.268850 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-os-release\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268271 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-os-release\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a7b7404-0732-4571-88aa-d47a794ff392-host\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268558 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268928 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2e818681-cf9b-4524-baa8-ec22c1932954-konnectivity-ca\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.268992 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a7b7404-0732-4571-88aa-d47a794ff392-serviceca\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-cnibin\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593a8963-dd81-4653-8b79-1f4769b6e1ef-system-cni-dir\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269224 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 17:09:29.269600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.269538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/593a8963-dd81-4653-8b79-1f4769b6e1ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.273389 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.273360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2e818681-cf9b-4524-baa8-ec22c1932954-agent-certs\") pod \"konnectivity-agent-brzzl\" (UID: \"2e818681-cf9b-4524-baa8-ec22c1932954\") " pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.277735 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.277693 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:29.277735 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.277732 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:29.277893 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.277748 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:29.277893 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.277827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:29.77780368 +0000 UTC m=+3.008396716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:29.279318 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.278478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgnb\" (UniqueName: \"kubernetes.io/projected/593a8963-dd81-4653-8b79-1f4769b6e1ef-kube-api-access-xcgnb\") pod \"multus-additional-cni-plugins-9n74f\" (UID: \"593a8963-dd81-4653-8b79-1f4769b6e1ef\") " pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.280080 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.280053 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx55w\" (UniqueName: \"kubernetes.io/projected/3a7b7404-0732-4571-88aa-d47a794ff392-kube-api-access-qx55w\") pod \"node-ca-mlw78\" (UID: \"3a7b7404-0732-4571-88aa-d47a794ff392\") " pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.368606 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-conf\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.368606 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsf5\" (UniqueName: \"kubernetes.io/projected/c9d07d5e-697e-4ea7-8152-71f3f809d854-kube-api-access-4zsf5\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a79f93a6-24d2-4367-bbd0-63ebadac002b-host-slash\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-multus-daemon-config\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrtz8\" (UniqueName: \"kubernetes.io/projected/0d2fe370-6ed4-4801-83f5-db007534479e-kube-api-access-mrtz8\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a79f93a6-24d2-4367-bbd0-63ebadac002b-host-slash\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368722 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-kubelet-config\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-dbus\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-etc-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-tmp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-sys-fs\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.368872 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-cnibin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-conf\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-var-lib-kubelet\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-multus\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqhl\" (UniqueName: \"kubernetes.io/projected/513fe9da-3496-4316-88db-9e0c135259e3-kube-api-access-4gqhl\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a79f93a6-24d2-4367-bbd0-63ebadac002b-iptables-alerter-script\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369073 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysctl-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-multus\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.368965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-var-lib-kubelet\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-bin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-cni-bin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-etc-kubernetes\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-script-lib\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpz8\" (UniqueName: \"kubernetes.io/projected/d396dde0-7e09-4fd7-a1b6-de7026b3e986-kube-api-access-2qpz8\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-dbus\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adf1f37f-20c2-460e-8af2-f63b45d86d84-kubelet-config\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369308 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-etc-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.370336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-etc-kubernetes\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-systemd-units\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-systemd-units\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-ovn\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-etc-tuned\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-sys-fs\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-host\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369469 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-cnibin\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-socket-dir-parent\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-749cr\" (UniqueName: \"kubernetes.io/projected/b911fba1-47dc-41b3-b599-c691b72732ab-kube-api-access-749cr\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-multus-daemon-config\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-log-socket\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-run\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369573 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-ovn\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-k8s-cni-cncf-io\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.371265 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369640 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-socket-dir-parent\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369647 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-host\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-kubelet\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369692 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-log-socket\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369711 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-run\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysconfig\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369735 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-k8s-cni-cncf-io\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-kubernetes\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9d07d5e-697e-4ea7-8152-71f3f809d854-hosts-file\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-sysconfig\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d07d5e-697e-4ea7-8152-71f3f809d854-tmp-dir\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369805 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-var-lib-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-kubelet\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-kubernetes\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-var-lib-openvswitch\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-env-overrides\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369898 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a79f93a6-24d2-4367-bbd0-63ebadac002b-iptables-alerter-script\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.372131 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369908 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9d07d5e-697e-4ea7-8152-71f3f809d854-hosts-file\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-lib-modules\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-registration-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.369984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-conf-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-netd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-lib-modules\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-conf-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-sys\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370085 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-registration-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370008 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-script-lib\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jf7v\" (UniqueName: \"kubernetes.io/projected/a79f93a6-24d2-4367-bbd0-63ebadac002b-kube-api-access-2jf7v\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370122 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-sys\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370150 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-netd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-os-release\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373113 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370147 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9d07d5e-697e-4ea7-8152-71f3f809d854-tmp-dir\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370239 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-os-release\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-systemd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-run-systemd\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370295 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-env-overrides\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-bin\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.370321 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370324 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-cni-bin\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-socket-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-hostroot\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.370382 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:09:29.870363926 +0000 UTC m=+3.100956972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-hostroot\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-device-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-cni-binary-copy\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-netns\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-socket-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-kubelet\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.373986 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-device-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-netns\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370535 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-var-lib-kubelet\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-config\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-modprobe-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-slash\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370703 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-netns\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-node-log\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovn-node-metrics-cert\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370856 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-netns\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-systemd\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmrp\" (UniqueName: \"kubernetes.io/projected/ae967b17-a854-48df-9078-e84ba362146e-kube-api-access-ftmrp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-system-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.374901 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-modprobe-d\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-multus-certs\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.370989 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-host-run-multus-certs\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371040 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d2fe370-6ed4-4801-83f5-db007534479e-cni-binary-copy\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.371068 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513fe9da-3496-4316-88db-9e0c135259e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae967b17-a854-48df-9078-e84ba362146e-etc-systemd\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371191 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovnkube-config\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.371205 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:29.871146596 +0000 UTC m=+3.101739613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-multus-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371249 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-host-slash\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d396dde0-7e09-4fd7-a1b6-de7026b3e986-node-log\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371319 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d2fe370-6ed4-4801-83f5-db007534479e-system-cni-dir\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.371818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-tmp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.372603 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae967b17-a854-48df-9078-e84ba362146e-etc-tuned\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.375799 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.374922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d396dde0-7e09-4fd7-a1b6-de7026b3e986-ovn-node-metrics-cert\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.379795 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.379754 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zsf5\" (UniqueName: \"kubernetes.io/projected/c9d07d5e-697e-4ea7-8152-71f3f809d854-kube-api-access-4zsf5\") pod \"node-resolver-v5hvm\" (UID: \"c9d07d5e-697e-4ea7-8152-71f3f809d854\") " pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.381120 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.380832 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:29.381818 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.381761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmrp\" (UniqueName: \"kubernetes.io/projected/ae967b17-a854-48df-9078-e84ba362146e-kube-api-access-ftmrp\") pod \"tuned-rzn7b\" (UID: \"ae967b17-a854-48df-9078-e84ba362146e\") " pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.382278 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.381864 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-749cr\" (UniqueName: \"kubernetes.io/projected/b911fba1-47dc-41b3-b599-c691b72732ab-kube-api-access-749cr\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.382278 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.382143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrtz8\" (UniqueName: \"kubernetes.io/projected/0d2fe370-6ed4-4801-83f5-db007534479e-kube-api-access-mrtz8\") pod \"multus-d54wp\" (UID: \"0d2fe370-6ed4-4801-83f5-db007534479e\") " pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.383375 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.383352 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jf7v\" (UniqueName: \"kubernetes.io/projected/a79f93a6-24d2-4367-bbd0-63ebadac002b-kube-api-access-2jf7v\") pod \"iptables-alerter-kb448\" (UID: \"a79f93a6-24d2-4367-bbd0-63ebadac002b\") " pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.383963 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.383939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpz8\" (UniqueName: \"kubernetes.io/projected/d396dde0-7e09-4fd7-a1b6-de7026b3e986-kube-api-access-2qpz8\") pod \"ovnkube-node-nvf9w\" (UID: \"d396dde0-7e09-4fd7-a1b6-de7026b3e986\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.384050 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.384031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqhl\" (UniqueName: \"kubernetes.io/projected/513fe9da-3496-4316-88db-9e0c135259e3-kube-api-access-4gqhl\") pod \"aws-ebs-csi-driver-node-c46pd\" (UID: \"513fe9da-3496-4316-88db-9e0c135259e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.398237 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.398094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" event={"ID":"d1def7bac9bf493198849b5b9d9d19c5","Type":"ContainerStarted","Data":"e65d61aaf78e8a2ac05faf951ea7318cae012cd7ebadd71a1858346ba14a2bb2"} Jul 28 17:09:29.464608 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.464577 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlw78" Jul 28 17:09:29.473957 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.473936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:29.482711 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.482684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9n74f" Jul 28 17:09:29.487697 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.487678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:29.493675 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.493494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" Jul 28 17:09:29.501422 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.501399 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d54wp" Jul 28 17:09:29.507264 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.507238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" Jul 28 17:09:29.513909 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.513889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5hvm" Jul 28 17:09:29.519871 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.519847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kb448" Jul 28 17:09:29.621864 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:29.621677 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513fe9da_3496_4316_88db_9e0c135259e3.slice/crio-b060ac9afa144c7f2fa79cdae847295d5739a85d3071ba7aad483811bf38409c WatchSource:0}: Error finding container b060ac9afa144c7f2fa79cdae847295d5739a85d3071ba7aad483811bf38409c: Status 404 returned error can't find the container with id b060ac9afa144c7f2fa79cdae847295d5739a85d3071ba7aad483811bf38409c Jul 28 17:09:29.629944 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:29.629916 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae967b17_a854_48df_9078_e84ba362146e.slice/crio-a1bc76b4459b18a5a900006be4ba78e32021f06f9809645658e98e805ebad7b9 WatchSource:0}: Error finding container a1bc76b4459b18a5a900006be4ba78e32021f06f9809645658e98e805ebad7b9: Status 404 returned error can't find the container with id a1bc76b4459b18a5a900006be4ba78e32021f06f9809645658e98e805ebad7b9 Jul 28 17:09:29.630912 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:29.630891 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2fe370_6ed4_4801_83f5_db007534479e.slice/crio-7b49f40030a92da5d4ba28a1c0de1dd1850e2c236e052ff64fc184f0dfc418cd WatchSource:0}: Error finding container 7b49f40030a92da5d4ba28a1c0de1dd1850e2c236e052ff64fc184f0dfc418cd: Status 404 returned error can't find the container with id 7b49f40030a92da5d4ba28a1c0de1dd1850e2c236e052ff64fc184f0dfc418cd Jul 28 17:09:29.632503 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:29.632472 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7b7404_0732_4571_88aa_d47a794ff392.slice/crio-dc46bbeea75b79f15b09555cd1aea587fc52e94b2827dd61d393281a7951dea1 WatchSource:0}: Error finding container dc46bbeea75b79f15b09555cd1aea587fc52e94b2827dd61d393281a7951dea1: Status 404 returned error can't find the container with id dc46bbeea75b79f15b09555cd1aea587fc52e94b2827dd61d393281a7951dea1 Jul 28 17:09:29.636656 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:09:29.636629 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79f93a6_24d2_4367_bbd0_63ebadac002b.slice/crio-98c857423e4c7d9bca1e167a3fbf793c1f21168007f0b77e884f5a25a16c36c8 WatchSource:0}: Error finding container 98c857423e4c7d9bca1e167a3fbf793c1f21168007f0b77e884f5a25a16c36c8: Status 404 returned error can't find the container with id 98c857423e4c7d9bca1e167a3fbf793c1f21168007f0b77e884f5a25a16c36c8 Jul 28 17:09:29.876310 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.876043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:29.876445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.876341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:29.876445 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876237 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:29.876445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:29.876414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:29.876445 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876443 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:09:30.876422914 +0000 UTC m=+4.107015931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876540 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876558 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876559 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876571 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876625 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:30.876605926 +0000 UTC m=+4.107198959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:29.876690 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:29.876646 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:30.876635223 +0000 UTC m=+4.107228257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:30.200751 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.200616 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:04:29 +0000 UTC" deadline="2027-12-22 12:41:15.370395606 +0000 UTC" Jul 28 17:09:30.200751 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.200675 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12283h31m45.169725533s" Jul 28 17:09:30.392656 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.392624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:30.392858 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.392774 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:30.406962 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.406927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" event={"ID":"ae967b17-a854-48df-9078-e84ba362146e","Type":"ContainerStarted","Data":"a1bc76b4459b18a5a900006be4ba78e32021f06f9809645658e98e805ebad7b9"} Jul 28 17:09:30.410533 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.410498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-brzzl" event={"ID":"2e818681-cf9b-4524-baa8-ec22c1932954","Type":"ContainerStarted","Data":"c5573fdd027ef4c5f82773729ed978f2299bbd42c8b08250e2b4db8d395c657d"} Jul 28 17:09:30.413964 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.413937 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"262b3eda7a0b39a496c4a254c1920a102fb2853d237a935900563c57fba186d4"} Jul 28 17:09:30.417025 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.416997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlw78" event={"ID":"3a7b7404-0732-4571-88aa-d47a794ff392","Type":"ContainerStarted","Data":"dc46bbeea75b79f15b09555cd1aea587fc52e94b2827dd61d393281a7951dea1"} Jul 28 17:09:30.420458 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.420433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d54wp" event={"ID":"0d2fe370-6ed4-4801-83f5-db007534479e","Type":"ContainerStarted","Data":"7b49f40030a92da5d4ba28a1c0de1dd1850e2c236e052ff64fc184f0dfc418cd"} Jul 28 17:09:30.422469 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.422444 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" event={"ID":"513fe9da-3496-4316-88db-9e0c135259e3","Type":"ContainerStarted","Data":"b060ac9afa144c7f2fa79cdae847295d5739a85d3071ba7aad483811bf38409c"} Jul 28 17:09:30.426644 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.426618 2578 generic.go:356] "Generic (PLEG): container finished" podID="f4f32b0fa224625ab6dea697da8ecf54" containerID="1dd5f58207bb0063b54eebe80cf54269e4e81787611d81fe00fee999b8a8789e" exitCode=0 Jul 28 17:09:30.426753 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.426701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" event={"ID":"f4f32b0fa224625ab6dea697da8ecf54","Type":"ContainerDied","Data":"1dd5f58207bb0063b54eebe80cf54269e4e81787611d81fe00fee999b8a8789e"} Jul 28 17:09:30.436505 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.436409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb448" event={"ID":"a79f93a6-24d2-4367-bbd0-63ebadac002b","Type":"ContainerStarted","Data":"98c857423e4c7d9bca1e167a3fbf793c1f21168007f0b77e884f5a25a16c36c8"} Jul 28 17:09:30.451045 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.450934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5hvm" event={"ID":"c9d07d5e-697e-4ea7-8152-71f3f809d854","Type":"ContainerStarted","Data":"9bdcb37ad5dbb052380fcc95a27f79ea0f207ac7a5ea497e0f1bedb43ccbca87"} Jul 28 17:09:30.458237 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.458193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerStarted","Data":"5d1493e2899d18626412f7752667dee06c13739a1556ed68fefced63877161cd"} Jul 28 17:09:30.885534 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.885492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:30.885739 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.885555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:30.885739 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.885586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:30.885739 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.885703 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:30.885880 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.885764 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.885746797 +0000 UTC m=+6.116339832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:30.886253 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886217 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:30.886253 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886242 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:30.886253 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886255 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:30.886475 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886303 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.886287014 +0000 UTC m=+6.116880029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:30.886475 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886373 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:30.886475 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:30.886409 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:09:32.886397096 +0000 UTC m=+6.116990127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:30.963662 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:30.963546 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 17:09:31.201045 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.200952 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:04:29 +0000 UTC" deadline="2028-04-08 07:38:55.951379894 +0000 UTC" Jul 28 17:09:31.201045 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.200994 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14870h29m24.750390506s" Jul 28 17:09:31.392676 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.392641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:31.392830 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:31.392774 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:31.393235 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.393218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:31.393345 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:31.393325 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:31.474162 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.474018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" event={"ID":"f4f32b0fa224625ab6dea697da8ecf54","Type":"ContainerStarted","Data":"14330c5776a03533e38ae07d3d2163a3bdc6ed1c1c1abe3253d8efc8c47993d3"} Jul 28 17:09:31.491376 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:31.491299 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-137.ec2.internal" podStartSLOduration=3.491275508 podStartE2EDuration="3.491275508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:31.49095275 +0000 UTC m=+4.721545787" watchObservedRunningTime="2026-07-28 17:09:31.491275508 +0000 UTC m=+4.721868547" Jul 28 17:09:32.392329 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:32.392296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:32.392791 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.392432 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:32.899496 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:32.899434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:32.899496 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:32.899494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:32.899800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:32.899530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:32.899800 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.899646 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:32.899800 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.899707 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:36.899689602 +0000 UTC m=+10.130282630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900198 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900222 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900236 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900281 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:36.90026721 +0000 UTC m=+10.130860229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900348 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:32.900459 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:32.900380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:09:36.900368523 +0000 UTC m=+10.130961538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:33.392390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:33.392355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:33.392800 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:33.392497 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:33.392800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:33.392583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:33.392800 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:33.392667 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:34.392560 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:34.392378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:34.392560 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:34.392505 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:35.392761 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:35.392686 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:35.393223 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:35.392813 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:35.393223 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:35.392843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:35.393223 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:35.392958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:36.392149 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:36.392111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:36.392337 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.392257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:36.933435 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:36.933403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:36.933461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:36.933496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933581 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933711 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933729 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933588 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933627 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933784 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:44.933769308 +0000 UTC m=+18.164362327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933803 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:09:44.933793007 +0000 UTC m=+18.164386022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:36.933898 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:36.933818 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:09:44.933810257 +0000 UTC m=+18.164403280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:37.393542 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:37.392925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:37.393542 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:37.393044 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:37.393542 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:37.393406 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:37.393542 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:37.393493 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:38.392721 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:38.392678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:38.393213 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:38.392819 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:39.395761 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:39.395731 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:39.396241 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:39.395732 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:39.396241 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:39.395863 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:39.396241 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:39.395929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:40.392299 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:40.392266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:40.392444 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:40.392372 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:41.393081 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:41.393044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:41.393528 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:41.393205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:41.393528 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:41.393052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:41.393634 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:41.393606 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:42.392105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:42.392066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:42.392287 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:42.392191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:43.395970 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:43.395939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:43.396450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:43.395946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:43.396450 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:43.396055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:43.396450 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:43.396170 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:44.393073 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:44.392977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:44.393276 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.393109 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:44.992862 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:44.992813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:44.992886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:44.992920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.992963 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.992993 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993005 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993015 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993036 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993068 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.993054505 +0000 UTC m=+34.223647519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993091 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.993080643 +0000 UTC m=+34.223673759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:09:44.993290 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:44.993106 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:10:00.993097427 +0000 UTC m=+34.223690442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:09:45.392960 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:45.392929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:45.393119 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:45.393066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:45.393199 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:45.393150 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:45.393298 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:45.393267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:46.392045 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:46.392015 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:46.392423 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:46.392120 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:47.394954 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:47.394923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:47.395388 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:47.395025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:47.395388 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:47.395089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:47.395388 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:47.395237 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:48.392759 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.392589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:48.392759 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:48.392703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:48.525558 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.525282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5hvm" event={"ID":"c9d07d5e-697e-4ea7-8152-71f3f809d854","Type":"ContainerStarted","Data":"a2d7c28dd6b251d2cacc94fed9571e74b52fc24929a7dfe9f544869e04ce7529"} Jul 28 17:09:48.534069 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.533557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerStarted","Data":"11003b1fedbdedc57ffc09cff5b24bb99a278ddd99c0ff0f77ebee0ce3e3f85f"} Jul 28 17:09:48.543156 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.542927 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5hvm" podStartSLOduration=3.05520019 podStartE2EDuration="21.54290768s" totalImagesPullingTime="18.48770749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.542161433 +0000 UTC m=+21.772754470" watchObservedRunningTime="2026-07-28 17:09:48.54290768 +0000 UTC m=+21.773500715" Jul 28 17:09:48.543646 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.543300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" event={"ID":"d1def7bac9bf493198849b5b9d9d19c5","Type":"ContainerStarted","Data":"cbfe205bc875e6c0d98173cd8e4e406c2edb4dad95acda065d5419d22c869724"} Jul 28 17:09:48.579402 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.579359 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" podStartSLOduration=2.894173039 podStartE2EDuration="21.579343027s" totalImagesPullingTime="18.685169988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.57879877 +0000 UTC m=+21.809391806" watchObservedRunningTime="2026-07-28 17:09:48.579343027 +0000 UTC m=+21.809936062" Jul 28 17:09:48.593824 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.593686 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-brzzl" podStartSLOduration=3.092926167 podStartE2EDuration="21.593670587s" totalImagesPullingTime="18.50074442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.593483297 +0000 UTC m=+21.824076332" watchObservedRunningTime="2026-07-28 17:09:48.593670587 +0000 UTC m=+21.824263624" Jul 28 17:09:48.607909 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.607821 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-137.ec2.internal" podStartSLOduration=20.607804788 podStartE2EDuration="20.607804788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.607112009 +0000 UTC m=+21.837705044" watchObservedRunningTime="2026-07-28 17:09:48.607804788 +0000 UTC m=+21.838397824" Jul 28 17:09:48.626295 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:48.626252 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mlw78" podStartSLOduration=3.138203674 podStartE2EDuration="21.626237276s" totalImagesPullingTime="18.488033602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:48.625679037 +0000 UTC m=+21.856272076" watchObservedRunningTime="2026-07-28 17:09:48.626237276 +0000 UTC m=+21.856830312" Jul 28 17:09:49.392909 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.392858 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:49.393088 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:49.393013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:49.393088 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.393036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:49.393234 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:49.393163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:49.548675 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.548641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kb448" event={"ID":"a79f93a6-24d2-4367-bbd0-63ebadac002b","Type":"ContainerStarted","Data":"d40bb588553c2be211ffe7b6e608804e3c6de524396720ce596d5ef02c2e1e6b"} Jul 28 17:09:49.550056 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.550029 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="11003b1fedbdedc57ffc09cff5b24bb99a278ddd99c0ff0f77ebee0ce3e3f85f" exitCode=0 Jul 28 17:09:49.550187 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.550088 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"11003b1fedbdedc57ffc09cff5b24bb99a278ddd99c0ff0f77ebee0ce3e3f85f"} Jul 28 17:09:49.551628 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.551606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rzn7b" event={"ID":"ae967b17-a854-48df-9078-e84ba362146e","Type":"ContainerStarted","Data":"dee41183574f00cf038ab469508cb0f84bb4e0211db21c0a1bf04a021f8b163f"} Jul 28 17:09:49.555970 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.555945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-brzzl" event={"ID":"2e818681-cf9b-4524-baa8-ec22c1932954","Type":"ContainerStarted","Data":"8918ccef76d5f0083add86d559164428ab0b9a75ceab1186773a7494864a8bf2"} Jul 28 17:09:49.558650 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"2fa800e56a8ffc0bbf348e3f8d2c1840ab6a457eddc2ed414a5551e812a9cbb2"} Jul 28 17:09:49.558744 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"e817b3b04fd9482ae8020e5f7472e98a0551c7a43a1fd25005482c70a94b8c75"} Jul 28 17:09:49.558744 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"39ee8b83cf7bdb07f9ca517314ed6ae6bd19ac678aa7e01638f3de05626a8137"} Jul 28 17:09:49.558834 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558755 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"1a0f840af19820c9f14f6b6758a90415d0f623e9a4d98336f96bac42663894ea"} Jul 28 17:09:49.558834 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"0ca7300647f4b247346cd223efa410ee2c6fa23ad439d0d80615ed01dabd2d14"} Jul 28 17:09:49.558834 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.558813 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"940e451f5cf3f5650821a094a8cdf3a13616976a0f9c62e10c6aceaa201ca433"} Jul 28 17:09:49.559780 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.559760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlw78" event={"ID":"3a7b7404-0732-4571-88aa-d47a794ff392","Type":"ContainerStarted","Data":"bf252726ae1bb01d2249d20bacf486c7193c2cd37b64c20b56ef6bf145f8874c"} Jul 28 17:09:49.561029 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.561011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d54wp" event={"ID":"0d2fe370-6ed4-4801-83f5-db007534479e","Type":"ContainerStarted","Data":"8fc764daf66763d6e9f63a0f10629be226deffa85fd4c9d7706f4900e14a4f9b"} Jul 28 17:09:49.562277 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.562256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" event={"ID":"513fe9da-3496-4316-88db-9e0c135259e3","Type":"ContainerStarted","Data":"89c52e44eaabe955fa5a47d9e0598e9524df312349d0c1326e8c0c2b2d3c46cb"} Jul 28 17:09:49.565493 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.565451 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kb448" podStartSLOduration=4.080040781 podStartE2EDuration="22.565437501s" totalImagesPullingTime="18.48539672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:49.564904803 +0000 UTC m=+22.795497838" watchObservedRunningTime="2026-07-28 17:09:49.565437501 +0000 UTC m=+22.796030538" Jul 28 17:09:49.613685 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.613593 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d54wp" podStartSLOduration=3.7790650550000002 podStartE2EDuration="22.613576692s" totalImagesPullingTime="18.834511637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:49.613466626 +0000 UTC m=+22.844059675" watchObservedRunningTime="2026-07-28 17:09:49.613576692 +0000 UTC m=+22.844169728" Jul 28 17:09:49.836242 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:49.836221 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 17:09:50.232110 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:50.231999 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:09:49.836237939Z","UUID":"46bd2e2c-a1a3-4663-a38d-4e8028e3cabc","Handler":null,"Name":"","Endpoint":""} Jul 28 17:09:50.233687 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:50.233661 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 17:09:50.233820 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:50.233705 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 17:09:50.392194 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:50.392161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:50.392415 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:50.392338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:50.567476 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:50.567386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" event={"ID":"513fe9da-3496-4316-88db-9e0c135259e3","Type":"ContainerStarted","Data":"fe7beaa6f8e2559e426fe17c31f187fe73a3a5e6bcf7a475398ca244edb030d8"} Jul 28 17:09:51.392700 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:51.392630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:51.392881 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:51.392753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:51.392881 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:51.392811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:51.392996 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:51.392899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:51.571853 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:51.571813 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" event={"ID":"513fe9da-3496-4316-88db-9e0c135259e3","Type":"ContainerStarted","Data":"bb8c64f8ecb4db3997cd20190bef55fab88a6789d235666f7fcf2d1c65a4c9c2"} Jul 28 17:09:51.575395 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:51.575369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"f6d35a4b24e6d4cf42f50b50c3d6a3ae18323f5943d6563ed4a0ec8a229473da"} Jul 28 17:09:51.591970 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:51.591918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c46pd" podStartSLOduration=4.000148658 podStartE2EDuration="24.591900797s" totalImagesPullingTime="20.591752139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:51.591399296 +0000 UTC m=+24.821992331" watchObservedRunningTime="2026-07-28 17:09:51.591900797 +0000 UTC m=+24.822493833" Jul 28 17:09:52.180657 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:52.180624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:52.181423 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:52.181255 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:52.392671 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:52.392640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:52.392840 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:52.392739 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:52.577964 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:52.577836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:52.578367 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:52.578234 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-brzzl" Jul 28 17:09:53.392233 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:53.392214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:53.392343 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:53.392214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:53.392343 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:53.392313 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:53.392419 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:53.392389 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:53.583747 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:53.583699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" event={"ID":"d396dde0-7e09-4fd7-a1b6-de7026b3e986","Type":"ContainerStarted","Data":"d56a2e9595e906043762a68cf8413ef0fcae9142ebcb54b7c300b0f423a8abbe"} Jul 28 17:09:53.610818 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:53.610757 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" podStartSLOduration=7.867471343 podStartE2EDuration="26.610736217s" totalImagesPullingTime="18.743264874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:53.610346719 +0000 UTC m=+26.840939756" watchObservedRunningTime="2026-07-28 17:09:53.610736217 +0000 UTC m=+26.841329253" Jul 28 17:09:54.392177 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.392147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:54.392349 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:54.392248 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:54.587536 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.587505 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="b3d0d2c925bb3af7520ee8795cd65983afcf0fd3482a7d15f74f9f384c167b33" exitCode=0 Jul 28 17:09:54.587934 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.587590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"b3d0d2c925bb3af7520ee8795cd65983afcf0fd3482a7d15f74f9f384c167b33"} Jul 28 17:09:54.588622 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.588377 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:54.588622 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.588452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:54.588622 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.588494 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:54.603240 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.603080 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:54.603357 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:54.603311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:09:55.392083 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.392057 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:55.392291 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:55.392207 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:55.392291 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.392253 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:55.392359 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:55.392348 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:55.447079 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.447047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mh8sc"] Jul 28 17:09:55.450445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.450419 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5p6p7"] Jul 28 17:09:55.450572 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.450513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:55.450646 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:55.450625 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:55.451095 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.451072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xwqnb"] Jul 28 17:09:55.589900 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.589874 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:55.589900 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:55.589899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:55.590414 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:55.589986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:55.590465 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:55.590410 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:56.594112 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:56.594076 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="2d5291a81c5aa61aaad8c3d1c7eb6551ec62301671ff31e970e5e534fe980ee7" exitCode=0 Jul 28 17:09:56.594490 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:56.594170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"2d5291a81c5aa61aaad8c3d1c7eb6551ec62301671ff31e970e5e534fe980ee7"} Jul 28 17:09:57.393643 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:57.393610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:57.393777 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:57.393648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:57.393777 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:57.393622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:57.393777 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:57.393721 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:57.393921 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:57.393804 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:09:57.393921 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:57.393859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:58.600899 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:58.600705 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="3bcafc5d4dd8126b29750bb1117c2c8eaaaa4951a882f30c48815a78a164f389" exitCode=0 Jul 28 17:09:58.600899 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:58.600792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"3bcafc5d4dd8126b29750bb1117c2c8eaaaa4951a882f30c48815a78a164f389"} Jul 28 17:09:59.395628 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:59.395602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:09:59.395812 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:59.395698 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:09:59.395812 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:09:59.395728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:09:59.395812 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:59.395712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:09:59.395957 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:59.395810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:09:59.395957 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:09:59.395893 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:10:01.014437 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.014397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.014469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.014505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014542 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014566 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014577 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mvwcz for pod openshift-network-diagnostics/network-check-target-5p6p7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014630 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014638 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz podName:e20f1528-fe02-455e-8508-17550d8ef947 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:33.014624478 +0000 UTC m=+66.245217511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mvwcz" (UniqueName: "kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz") pod "network-check-target-5p6p7" (UID: "e20f1528-fe02-455e-8508-17550d8ef947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014630 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014680 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret podName:adf1f37f-20c2-460e-8af2-f63b45d86d84 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:33.014664604 +0000 UTC m=+66.245257624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret") pod "global-pull-secret-syncer-mh8sc" (UID: "adf1f37f-20c2-460e-8af2-f63b45d86d84") : object "kube-system"/"original-pull-secret" not registered Jul 28 17:10:01.014947 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.014723 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs podName:b911fba1-47dc-41b3-b599-c691b72732ab nodeName:}" failed. No retries permitted until 2026-07-28 17:10:33.014709058 +0000 UTC m=+66.245302077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs") pod "network-metrics-daemon-xwqnb" (UID: "b911fba1-47dc-41b3-b599-c691b72732ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 17:10:01.393022 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.392902 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:01.393022 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.392913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:01.393022 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.393018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mh8sc" podUID="adf1f37f-20c2-460e-8af2-f63b45d86d84" Jul 28 17:10:01.393318 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.393103 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwqnb" podUID="b911fba1-47dc-41b3-b599-c691b72732ab" Jul 28 17:10:01.393318 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:01.393155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:01.393318 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:01.393268 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5p6p7" podUID="e20f1528-fe02-455e-8508-17550d8ef947" Jul 28 17:10:02.089789 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.089755 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-137.ec2.internal" event="NodeReady" Jul 28 17:10:02.090306 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.089896 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 17:10:02.136879 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.136804 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dcn54"] Jul 28 17:10:02.139527 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.139494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.139527 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.139507 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bfwh9"] Jul 28 17:10:02.141302 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.141280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.142068 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.142047 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 17:10:02.142208 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.142087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 17:10:02.142208 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.142099 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8842r\"" Jul 28 17:10:02.143908 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.143890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 17:10:02.145490 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.145355 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 17:10:02.145490 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.145362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q4trs\"" Jul 28 17:10:02.145490 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.145416 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 17:10:02.152078 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.151474 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dcn54"] Jul 28 17:10:02.152320 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.152294 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfwh9"] Jul 28 17:10:02.222451 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae3487-72a9-47f6-8984-f6bb5a886904-tmp-dir\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.222642 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.222642 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87tqf\" (UniqueName: \"kubernetes.io/projected/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-kube-api-access-87tqf\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.222642 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq2zz\" (UniqueName: \"kubernetes.io/projected/33ae3487-72a9-47f6-8984-f6bb5a886904-kube-api-access-wq2zz\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.222797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33ae3487-72a9-47f6-8984-f6bb5a886904-config-volume\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.222797 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.222694 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-cert\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.323951 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.323912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq2zz\" (UniqueName: \"kubernetes.io/projected/33ae3487-72a9-47f6-8984-f6bb5a886904-kube-api-access-wq2zz\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.324114 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.323978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33ae3487-72a9-47f6-8984-f6bb5a886904-config-volume\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.324114 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-cert\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.324114 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae3487-72a9-47f6-8984-f6bb5a886904-tmp-dir\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.324114 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.324114 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87tqf\" (UniqueName: \"kubernetes.io/projected/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-kube-api-access-87tqf\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.324481 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:02.324456 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:02.324558 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:02.324530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls podName:33ae3487-72a9-47f6-8984-f6bb5a886904 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:02.82450877 +0000 UTC m=+36.055101798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls") pod "dns-default-dcn54" (UID: "33ae3487-72a9-47f6-8984-f6bb5a886904") : secret "dns-default-metrics-tls" not found Jul 28 17:10:02.324621 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33ae3487-72a9-47f6-8984-f6bb5a886904-tmp-dir\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.324666 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.324635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/33ae3487-72a9-47f6-8984-f6bb5a886904-config-volume\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.328882 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.328861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-cert\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.333833 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.333723 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87tqf\" (UniqueName: \"kubernetes.io/projected/59db2eca-ec1b-4103-8d0d-dcee0f03d5e5-kube-api-access-87tqf\") pod \"ingress-canary-bfwh9\" (UID: \"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5\") " pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.333833 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.333725 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq2zz\" (UniqueName: \"kubernetes.io/projected/33ae3487-72a9-47f6-8984-f6bb5a886904-kube-api-access-wq2zz\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.458078 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.458059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bfwh9" Jul 28 17:10:02.600015 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.599754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bfwh9"] Jul 28 17:10:02.603622 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:02.603596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59db2eca_ec1b_4103_8d0d_dcee0f03d5e5.slice/crio-d8e92dc7e686e87bd4262378eab60e3180a6792160b798f1a1f5203f2efb8250 WatchSource:0}: Error finding container d8e92dc7e686e87bd4262378eab60e3180a6792160b798f1a1f5203f2efb8250: Status 404 returned error can't find the container with id d8e92dc7e686e87bd4262378eab60e3180a6792160b798f1a1f5203f2efb8250 Jul 28 17:10:02.614212 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.614179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerStarted","Data":"fda80a3c0e96a9cc2f5fbebb328f8d4ab35290674fa19fd99ecffb0517762494"} Jul 28 17:10:02.615392 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.615370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfwh9" event={"ID":"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5","Type":"ContainerStarted","Data":"d8e92dc7e686e87bd4262378eab60e3180a6792160b798f1a1f5203f2efb8250"} Jul 28 17:10:02.829020 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:02.828991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:02.829196 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:02.829157 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:02.829235 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:02.829227 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls podName:33ae3487-72a9-47f6-8984-f6bb5a886904 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:03.829210374 +0000 UTC m=+37.059803388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls") pod "dns-default-dcn54" (UID: "33ae3487-72a9-47f6-8984-f6bb5a886904") : secret "dns-default-metrics-tls" not found Jul 28 17:10:03.392930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.392891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:03.393765 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.393029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:03.393765 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.392898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:03.396781 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396756 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:10:03.396781 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396773 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvllg\"" Jul 28 17:10:03.396781 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396776 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:10:03.396958 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mz7f2\"" Jul 28 17:10:03.396958 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:10:03.396958 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.396865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:10:03.621436 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.621341 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="fda80a3c0e96a9cc2f5fbebb328f8d4ab35290674fa19fd99ecffb0517762494" exitCode=0 Jul 28 17:10:03.621436 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.621387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"fda80a3c0e96a9cc2f5fbebb328f8d4ab35290674fa19fd99ecffb0517762494"} Jul 28 17:10:03.838214 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:03.838183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:03.838408 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:03.838313 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:03.838408 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:03.838381 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls podName:33ae3487-72a9-47f6-8984-f6bb5a886904 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:05.838361401 +0000 UTC m=+39.068954431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls") pod "dns-default-dcn54" (UID: "33ae3487-72a9-47f6-8984-f6bb5a886904") : secret "dns-default-metrics-tls" not found Jul 28 17:10:04.628567 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:04.628528 2578 generic.go:356] "Generic (PLEG): container finished" podID="593a8963-dd81-4653-8b79-1f4769b6e1ef" containerID="0be779a000f6ff7f127fcc972ecdb732b5fc3de74f18abc40f354fda143a9048" exitCode=0 Jul 28 17:10:04.629087 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:04.628615 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerDied","Data":"0be779a000f6ff7f127fcc972ecdb732b5fc3de74f18abc40f354fda143a9048"} Jul 28 17:10:05.634831 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:05.634609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9n74f" event={"ID":"593a8963-dd81-4653-8b79-1f4769b6e1ef","Type":"ContainerStarted","Data":"7fc292e11ee76ee518ad69a2258322120a9b150e853a468dc1c8878a995bf0c2"} Jul 28 17:10:05.636076 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:05.636052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bfwh9" event={"ID":"59db2eca-ec1b-4103-8d0d-dcee0f03d5e5","Type":"ContainerStarted","Data":"edca11b1e66b0cf1745353b0e49f4d06d1f53732f1f3820ded7b5d0875e1ed71"} Jul 28 17:10:05.674341 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:05.674281 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9n74f" podStartSLOduration=14.160372608 podStartE2EDuration="38.674260849s" totalImagesPullingTime="24.513888241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:05.67240489 +0000 UTC m=+38.902997952" watchObservedRunningTime="2026-07-28 17:10:05.674260849 +0000 UTC m=+38.904853886" Jul 28 17:10:05.699571 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:05.699518 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bfwh9" podStartSLOduration=0.841982712 podStartE2EDuration="3.699503482s" totalImagesPullingTime="2.85752077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:05.699334866 +0000 UTC m=+38.929927902" watchObservedRunningTime="2026-07-28 17:10:05.699503482 +0000 UTC m=+38.930096509" Jul 28 17:10:05.856369 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:05.856338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:05.856559 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:05.856536 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:05.856643 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:05.856630 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls podName:33ae3487-72a9-47f6-8984-f6bb5a886904 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:09.856606049 +0000 UTC m=+43.087199086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls") pod "dns-default-dcn54" (UID: "33ae3487-72a9-47f6-8984-f6bb5a886904") : secret "dns-default-metrics-tls" not found Jul 28 17:10:07.316953 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.316922 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wpdnk"] Jul 28 17:10:07.339261 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.339227 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpdnk"] Jul 28 17:10:07.339425 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.339354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.345605 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.345352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 17:10:07.345605 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.345422 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 17:10:07.345727 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.345718 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 17:10:07.346535 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.346510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 17:10:07.346630 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.346558 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8pw\"" Jul 28 17:10:07.470796 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.470762 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-crio-socket\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.470796 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.470808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-data-volume\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.471021 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.470843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.471021 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.470865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.471021 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.470891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8qlj\" (UniqueName: \"kubernetes.io/projected/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-api-access-t8qlj\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571145 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8qlj\" (UniqueName: \"kubernetes.io/projected/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-api-access-t8qlj\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571239 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-crio-socket\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571346 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-crio-socket\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571411 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-data-volume\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571411 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571411 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.571533 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:07.571473 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:07.571533 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:07.571490 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:07.571615 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:07.571536 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:08.071522945 +0000 UTC m=+41.302115959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:07.571615 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:07.571558 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:08.071551267 +0000 UTC m=+41.302144281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : configmap "kube-rbac-proxy" not found Jul 28 17:10:07.571721 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.571659 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-data-volume\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:07.582453 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:07.582430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8qlj\" (UniqueName: \"kubernetes.io/projected/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-api-access-t8qlj\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:08.075862 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:08.075838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:08.076012 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:08.075869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:08.076012 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:08.075970 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:08.076012 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:08.075985 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:08.076107 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:08.076022 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:09.076008873 +0000 UTC m=+42.306601888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : configmap "kube-rbac-proxy" not found Jul 28 17:10:08.076107 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:08.076072 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:09.07605956 +0000 UTC m=+42.306652578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:09.027277 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.027244 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7"] Jul 28 17:10:09.061399 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.061369 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7"] Jul 28 17:10:09.061543 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.061480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" Jul 28 17:10:09.064085 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.064059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 17:10:09.065207 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.065185 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bjnj4\"" Jul 28 17:10:09.065207 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.065197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 17:10:09.081722 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.081698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:09.081800 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.081728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:09.081846 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.081831 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:09.081893 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.081859 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:09.081929 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.081896 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:11.081878064 +0000 UTC m=+44.312471082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : configmap "kube-rbac-proxy" not found Jul 28 17:10:09.081929 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.081910 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:11.08190431 +0000 UTC m=+44.312497324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:09.182224 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.182187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-947cj\" (UniqueName: \"kubernetes.io/projected/81c64da5-ca18-427e-9f36-7d62e054a5fb-kube-api-access-947cj\") pod \"migrator-6865c9967-cktc7\" (UID: \"81c64da5-ca18-427e-9f36-7d62e054a5fb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" Jul 28 17:10:09.282761 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.282696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-947cj\" (UniqueName: \"kubernetes.io/projected/81c64da5-ca18-427e-9f36-7d62e054a5fb-kube-api-access-947cj\") pod \"migrator-6865c9967-cktc7\" (UID: \"81c64da5-ca18-427e-9f36-7d62e054a5fb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" Jul 28 17:10:09.291628 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.291603 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-947cj\" (UniqueName: \"kubernetes.io/projected/81c64da5-ca18-427e-9f36-7d62e054a5fb-kube-api-access-947cj\") pod \"migrator-6865c9967-cktc7\" (UID: \"81c64da5-ca18-427e-9f36-7d62e054a5fb\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" Jul 28 17:10:09.294577 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.294554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5hvm_c9d07d5e-697e-4ea7-8152-71f3f809d854/dns-node-resolver/0.log" Jul 28 17:10:09.369925 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.369887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" Jul 28 17:10:09.527536 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.527505 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7"] Jul 28 17:10:09.530586 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:09.530559 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c64da5_ca18_427e_9f36_7d62e054a5fb.slice/crio-a5bad2fb1bab045467e189566cfa5c7f8388fd0b59452c7031ee581168648c81 WatchSource:0}: Error finding container a5bad2fb1bab045467e189566cfa5c7f8388fd0b59452c7031ee581168648c81: Status 404 returned error can't find the container with id a5bad2fb1bab045467e189566cfa5c7f8388fd0b59452c7031ee581168648c81 Jul 28 17:10:09.646632 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.646599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" event={"ID":"81c64da5-ca18-427e-9f36-7d62e054a5fb","Type":"ContainerStarted","Data":"a5bad2fb1bab045467e189566cfa5c7f8388fd0b59452c7031ee581168648c81"} Jul 28 17:10:09.888536 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:09.888504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:09.888709 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.888630 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 17:10:09.888709 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:09.888683 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls podName:33ae3487-72a9-47f6-8984-f6bb5a886904 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:17.8886697 +0000 UTC m=+51.119262715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls") pod "dns-default-dcn54" (UID: "33ae3487-72a9-47f6-8984-f6bb5a886904") : secret "dns-default-metrics-tls" not found Jul 28 17:10:10.494972 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:10.494941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlw78_3a7b7404-0732-4571-88aa-d47a794ff392/node-ca/0.log" Jul 28 17:10:10.894413 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:10.894387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfwh9_59db2eca-ec1b-4103-8d0d-dcee0f03d5e5/serve-healthcheck-canary/0.log" Jul 28 17:10:11.096867 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:11.096839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:11.097001 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:11.096873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:11.097001 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:11.096953 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 17:10:11.097001 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:11.096990 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:11.097227 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:11.097016 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:15.097003312 +0000 UTC m=+48.327596326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : configmap "kube-rbac-proxy" not found Jul 28 17:10:11.097227 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:11.097038 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:15.097024069 +0000 UTC m=+48.327617083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:11.652705 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:11.652670 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" event={"ID":"81c64da5-ca18-427e-9f36-7d62e054a5fb","Type":"ContainerStarted","Data":"ab395a4d2310dcc807d45f557bf6344b7e7a3191c889b39b7303225e93412965"} Jul 28 17:10:11.653216 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:11.652720 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" event={"ID":"81c64da5-ca18-427e-9f36-7d62e054a5fb","Type":"ContainerStarted","Data":"b44a52ff2c742db4cda56aada12d8993badd0d33fc7fe5a438d19f0354429ee2"} Jul 28 17:10:11.678367 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:11.678320 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-cktc7" podStartSLOduration=1.2873919169999999 podStartE2EDuration="2.678302514s" totalImagesPullingTime="1.390910597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:11.678108617 +0000 UTC m=+44.908701652" watchObservedRunningTime="2026-07-28 17:10:11.678302514 +0000 UTC m=+44.908895552" Jul 28 17:10:15.129427 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:15.129383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:15.129821 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:15.129441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:15.129821 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:15.129550 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 17:10:15.129821 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:15.129639 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls podName:d118381d-e8ad-4eb4-afbf-7cc5c1f69888 nodeName:}" failed. No retries permitted until 2026-07-28 17:10:23.129622987 +0000 UTC m=+56.360216001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wpdnk" (UID: "d118381d-e8ad-4eb4-afbf-7cc5c1f69888") : secret "insights-runtime-extractor-tls" not found Jul 28 17:10:15.129995 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:15.129978 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:17.949949 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:17.949908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:17.952071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:17.952052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/33ae3487-72a9-47f6-8984-f6bb5a886904-metrics-tls\") pod \"dns-default-dcn54\" (UID: \"33ae3487-72a9-47f6-8984-f6bb5a886904\") " pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:18.052976 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:18.052945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:18.197368 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:18.197337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dcn54"] Jul 28 17:10:18.200917 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:18.200863 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ae3487_72a9_47f6_8984_f6bb5a886904.slice/crio-fe6e042260ecfeca311db29dec52adc4140712771846e1cab82e57ab786b20dc WatchSource:0}: Error finding container fe6e042260ecfeca311db29dec52adc4140712771846e1cab82e57ab786b20dc: Status 404 returned error can't find the container with id fe6e042260ecfeca311db29dec52adc4140712771846e1cab82e57ab786b20dc Jul 28 17:10:18.670091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:18.670055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcn54" event={"ID":"33ae3487-72a9-47f6-8984-f6bb5a886904","Type":"ContainerStarted","Data":"fe6e042260ecfeca311db29dec52adc4140712771846e1cab82e57ab786b20dc"} Jul 28 17:10:20.675679 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:20.675641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcn54" event={"ID":"33ae3487-72a9-47f6-8984-f6bb5a886904","Type":"ContainerStarted","Data":"da84f9996bbe6b6998855785e0d747c36b8661aa563a590af1448fd9ddffc830"} Jul 28 17:10:20.676124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:20.675726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dcn54" event={"ID":"33ae3487-72a9-47f6-8984-f6bb5a886904","Type":"ContainerStarted","Data":"6153e7d32c70dbc6a9e72d35cb76690ddfdd281e925571246c0da5213d5d7439"} Jul 28 17:10:20.676124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:20.675781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:20.695282 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:20.695237 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dcn54" podStartSLOduration=16.860563887 podStartE2EDuration="18.69521982s" totalImagesPullingTime="1.834655933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:20.694502605 +0000 UTC m=+53.925095640" watchObservedRunningTime="2026-07-28 17:10:20.69521982 +0000 UTC m=+53.925812857" Jul 28 17:10:23.186637 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:23.186596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:23.188844 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:23.188823 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d118381d-e8ad-4eb4-afbf-7cc5c1f69888-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpdnk\" (UID: \"d118381d-e8ad-4eb4-afbf-7cc5c1f69888\") " pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:23.248390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:23.248357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpdnk" Jul 28 17:10:23.369112 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:23.369080 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpdnk"] Jul 28 17:10:23.372015 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:23.371988 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd118381d_e8ad_4eb4_afbf_7cc5c1f69888.slice/crio-781923c74c8150da23af3cb613e42a44964fd265becbd866ae98d238062565ef WatchSource:0}: Error finding container 781923c74c8150da23af3cb613e42a44964fd265becbd866ae98d238062565ef: Status 404 returned error can't find the container with id 781923c74c8150da23af3cb613e42a44964fd265becbd866ae98d238062565ef Jul 28 17:10:23.684252 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:23.684213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpdnk" event={"ID":"d118381d-e8ad-4eb4-afbf-7cc5c1f69888","Type":"ContainerStarted","Data":"781923c74c8150da23af3cb613e42a44964fd265becbd866ae98d238062565ef"} Jul 28 17:10:26.605579 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:26.605551 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvf9w" Jul 28 17:10:28.698846 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:28.698809 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpdnk" event={"ID":"d118381d-e8ad-4eb4-afbf-7cc5c1f69888","Type":"ContainerStarted","Data":"f2d758189d57312864eef3328e1e142d48d1e223d1c8d36f37d42b150c69664d"} Jul 28 17:10:30.636784 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.636749 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c"] Jul 28 17:10:30.647711 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.647688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.654656 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.654610 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c"] Jul 28 17:10:30.654910 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.654880 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 17:10:30.655041 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.655019 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 17:10:30.655158 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.655057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 17:10:30.656014 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.655761 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 17:10:30.656014 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.655813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 17:10:30.656014 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.655857 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 17:10:30.656499 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.656399 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 17:10:30.680471 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.680445 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dcn54" Jul 28 17:10:30.741233 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.741233 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.741467 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741267 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.741467 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.741653 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db98366-9f8e-4bdd-ac3e-0405d9635e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.741780 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.741661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmnt\" (UniqueName: \"kubernetes.io/projected/6db98366-9f8e-4bdd-ac3e-0405d9635e77-kube-api-access-txmnt\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.743488 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.743464 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bddc5d8db-llrzt"] Jul 28 17:10:30.748252 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.748232 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.751130 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.750973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 17:10:30.751130 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.750972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6jkxz\"" Jul 28 17:10:30.751426 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.751407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 17:10:30.751530 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.751442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 17:10:30.762026 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.762005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 17:10:30.765101 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.765074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bddc5d8db-llrzt"] Jul 28 17:10:30.842629 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a52ce28-58e1-43da-a242-e67422adb356-ca-trust-extracted\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-trusted-ca\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.842775 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-registry-tls\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-bound-sa-token\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-image-registry-private-configuration\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.842991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkwgz\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-kube-api-access-xkwgz\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.843018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-registry-certificates\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.843058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db98366-9f8e-4bdd-ac3e-0405d9635e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.843324 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.843084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmnt\" (UniqueName: \"kubernetes.io/projected/6db98366-9f8e-4bdd-ac3e-0405d9635e77-kube-api-access-txmnt\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.843324 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.843114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-installation-pull-secrets\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.843846 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.843817 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6db98366-9f8e-4bdd-ac3e-0405d9635e77-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.845735 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.845710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-ca\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.845852 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.845755 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.846313 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.846291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.846414 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.846334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6db98366-9f8e-4bdd-ac3e-0405d9635e77-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.852902 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.852851 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmnt\" (UniqueName: \"kubernetes.io/projected/6db98366-9f8e-4bdd-ac3e-0405d9635e77-kube-api-access-txmnt\") pod \"cluster-proxy-proxy-agent-59994bb6df-zbk7c\" (UID: \"6db98366-9f8e-4bdd-ac3e-0405d9635e77\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:30.943883 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a52ce28-58e1-43da-a242-e67422adb356-ca-trust-extracted\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.943883 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-trusted-ca\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.943883 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-registry-tls\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944188 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943890 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-bound-sa-token\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944188 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-image-registry-private-configuration\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944188 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943937 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkwgz\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-kube-api-access-xkwgz\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944188 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.943953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-registry-certificates\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944188 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.944023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-installation-pull-secrets\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944562 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.944438 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a52ce28-58e1-43da-a242-e67422adb356-ca-trust-extracted\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.944930 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.944884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-trusted-ca\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.945203 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.945178 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a52ce28-58e1-43da-a242-e67422adb356-registry-certificates\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.946806 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.946786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-image-registry-private-configuration\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.946916 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.946895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-registry-tls\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.947013 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.946993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a52ce28-58e1-43da-a242-e67422adb356-installation-pull-secrets\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.955811 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.955783 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-bound-sa-token\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.956308 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.956292 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkwgz\" (UniqueName: \"kubernetes.io/projected/6a52ce28-58e1-43da-a242-e67422adb356-kube-api-access-xkwgz\") pod \"image-registry-6bddc5d8db-llrzt\" (UID: \"6a52ce28-58e1-43da-a242-e67422adb356\") " pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:30.965316 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:30.965297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" Jul 28 17:10:31.062402 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:31.062368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:31.917336 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:31.917304 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c"] Jul 28 17:10:31.920908 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:31.920883 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6db98366_9f8e_4bdd_ac3e_0405d9635e77.slice/crio-6be69e6cb093b438b98772c8a94bac426957feccf4d59e615000b7f75886925b WatchSource:0}: Error finding container 6be69e6cb093b438b98772c8a94bac426957feccf4d59e615000b7f75886925b: Status 404 returned error can't find the container with id 6be69e6cb093b438b98772c8a94bac426957feccf4d59e615000b7f75886925b Jul 28 17:10:31.932455 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:31.932411 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bddc5d8db-llrzt"] Jul 28 17:10:31.935723 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:31.935697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a52ce28_58e1_43da_a242_e67422adb356.slice/crio-4e4ff501e1a689f4c27605d2d74753cced78ba0e9277c91ec8968a496effd789 WatchSource:0}: Error finding container 4e4ff501e1a689f4c27605d2d74753cced78ba0e9277c91ec8968a496effd789: Status 404 returned error can't find the container with id 4e4ff501e1a689f4c27605d2d74753cced78ba0e9277c91ec8968a496effd789 Jul 28 17:10:32.714056 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:32.714014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpdnk" event={"ID":"d118381d-e8ad-4eb4-afbf-7cc5c1f69888","Type":"ContainerStarted","Data":"d7841d89a478235cef18db74637e6325d0b6092b7d5863bc45b723c2cd488fc8"} Jul 28 17:10:32.715699 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:32.715647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" event={"ID":"6a52ce28-58e1-43da-a242-e67422adb356","Type":"ContainerStarted","Data":"5b4ca61990c7403f1e871fb37f7ceee9ec288ff9f6eda5a88eb32c4de571fdcc"} Jul 28 17:10:32.715839 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:32.715817 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:32.715967 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:32.715870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" event={"ID":"6a52ce28-58e1-43da-a242-e67422adb356","Type":"ContainerStarted","Data":"4e4ff501e1a689f4c27605d2d74753cced78ba0e9277c91ec8968a496effd789"} Jul 28 17:10:32.716837 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:32.716818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" event={"ID":"6db98366-9f8e-4bdd-ac3e-0405d9635e77","Type":"ContainerStarted","Data":"6be69e6cb093b438b98772c8a94bac426957feccf4d59e615000b7f75886925b"} Jul 28 17:10:33.063988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.063908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:33.063988 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.063952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:33.064540 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.064002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:33.066634 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.066610 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 17:10:33.066717 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.066610 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 17:10:33.066717 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.066610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 17:10:33.077253 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.077228 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adf1f37f-20c2-460e-8af2-f63b45d86d84-original-pull-secret\") pod \"global-pull-secret-syncer-mh8sc\" (UID: \"adf1f37f-20c2-460e-8af2-f63b45d86d84\") " pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:33.077377 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.077254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b911fba1-47dc-41b3-b599-c691b72732ab-metrics-certs\") pod \"network-metrics-daemon-xwqnb\" (UID: \"b911fba1-47dc-41b3-b599-c691b72732ab\") " pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:33.078229 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.078204 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 17:10:33.087948 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.087924 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwcz\" (UniqueName: \"kubernetes.io/projected/e20f1528-fe02-455e-8508-17550d8ef947-kube-api-access-mvwcz\") pod \"network-check-target-5p6p7\" (UID: \"e20f1528-fe02-455e-8508-17550d8ef947\") " pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:33.108802 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.108772 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mz7f2\"" Jul 28 17:10:33.110920 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.110889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mh8sc" Jul 28 17:10:33.116069 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.116047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:33.117483 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.117463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nvllg\"" Jul 28 17:10:33.125795 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.125527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwqnb" Jul 28 17:10:33.273331 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.273127 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" podStartSLOduration=3.273108902 podStartE2EDuration="3.273108902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:32.737668314 +0000 UTC m=+65.968261349" watchObservedRunningTime="2026-07-28 17:10:33.273108902 +0000 UTC m=+66.503701918" Jul 28 17:10:33.274288 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.274266 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mh8sc"] Jul 28 17:10:33.277148 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:33.277106 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf1f37f_20c2_460e_8af2_f63b45d86d84.slice/crio-608963cdb1b1c699de638b29275e31fe9f7f67fc8d5a40e5bd0a5491da7060d7 WatchSource:0}: Error finding container 608963cdb1b1c699de638b29275e31fe9f7f67fc8d5a40e5bd0a5491da7060d7: Status 404 returned error can't find the container with id 608963cdb1b1c699de638b29275e31fe9f7f67fc8d5a40e5bd0a5491da7060d7 Jul 28 17:10:33.493086 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.493054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5p6p7"] Jul 28 17:10:33.495847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.495776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xwqnb"] Jul 28 17:10:33.496544 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:33.496506 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20f1528_fe02_455e_8508_17550d8ef947.slice/crio-2febe5d4d97828e81ad34de237bb2cce2056e901c91957407e67cd732cb6ccb7 WatchSource:0}: Error finding container 2febe5d4d97828e81ad34de237bb2cce2056e901c91957407e67cd732cb6ccb7: Status 404 returned error can't find the container with id 2febe5d4d97828e81ad34de237bb2cce2056e901c91957407e67cd732cb6ccb7 Jul 28 17:10:33.500158 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:33.500080 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb911fba1_47dc_41b3_b599_c691b72732ab.slice/crio-e7b623b7a116702eb89b1ac6b6f2cf5978c56a8b2356e39f78b033264b314c24 WatchSource:0}: Error finding container e7b623b7a116702eb89b1ac6b6f2cf5978c56a8b2356e39f78b033264b314c24: Status 404 returned error can't find the container with id e7b623b7a116702eb89b1ac6b6f2cf5978c56a8b2356e39f78b033264b314c24 Jul 28 17:10:33.728645 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.728604 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5p6p7" event={"ID":"e20f1528-fe02-455e-8508-17550d8ef947","Type":"ContainerStarted","Data":"2febe5d4d97828e81ad34de237bb2cce2056e901c91957407e67cd732cb6ccb7"} Jul 28 17:10:33.730052 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.730022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwqnb" event={"ID":"b911fba1-47dc-41b3-b599-c691b72732ab","Type":"ContainerStarted","Data":"e7b623b7a116702eb89b1ac6b6f2cf5978c56a8b2356e39f78b033264b314c24"} Jul 28 17:10:33.731433 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:33.731411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mh8sc" event={"ID":"adf1f37f-20c2-460e-8af2-f63b45d86d84","Type":"ContainerStarted","Data":"608963cdb1b1c699de638b29275e31fe9f7f67fc8d5a40e5bd0a5491da7060d7"} Jul 28 17:10:37.759606 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:37.759567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpdnk" event={"ID":"d118381d-e8ad-4eb4-afbf-7cc5c1f69888","Type":"ContainerStarted","Data":"145a74dd597763fda6710f2b41ca598517a576391efac0676884755827b9fac7"} Jul 28 17:10:37.805229 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:37.804000 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wpdnk" podStartSLOduration=16.684097253 podStartE2EDuration="30.803984912s" totalImagesPullingTime="14.119887659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:37.782330314 +0000 UTC m=+71.012923351" watchObservedRunningTime="2026-07-28 17:10:37.803984912 +0000 UTC m=+71.034577947" Jul 28 17:10:37.805229 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:37.804168 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mh8sc" podStartSLOduration=66.448868877 podStartE2EDuration="1m10.804159798s" totalImagesPullingTime="4.355290921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:37.803749794 +0000 UTC m=+71.034342831" watchObservedRunningTime="2026-07-28 17:10:37.804159798 +0000 UTC m=+71.034752835" Jul 28 17:10:38.772701 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:38.772649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mh8sc" event={"ID":"adf1f37f-20c2-460e-8af2-f63b45d86d84","Type":"ContainerStarted","Data":"4b144a37174e96a2a2e3fa4e911c7f2be2a13ae095455c8b60d209ec5b492418"} Jul 28 17:10:41.782810 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.782770 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" event={"ID":"6db98366-9f8e-4bdd-ac3e-0405d9635e77","Type":"ContainerStarted","Data":"f3db665c57d349a2e6fa7eacad59d9e45297da16a027a4f1a9e84eb9b97e44cf"} Jul 28 17:10:41.783258 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.782822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" event={"ID":"6db98366-9f8e-4bdd-ac3e-0405d9635e77","Type":"ContainerStarted","Data":"54e736865c3bada63d2ad8720ebd527f792d80bf78b53e6c69123eecffd7d3b2"} Jul 28 17:10:41.783258 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.782841 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" event={"ID":"6db98366-9f8e-4bdd-ac3e-0405d9635e77","Type":"ContainerStarted","Data":"5786ea43b2d9a9d3bbf42dabf99badff2ee46eef9137c01ea136e4827dd8a108"} Jul 28 17:10:41.784201 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.784178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5p6p7" event={"ID":"e20f1528-fe02-455e-8508-17550d8ef947","Type":"ContainerStarted","Data":"c621308f3a6e06a764e0421a504e156064ab1ffffe4760589184814f8d3cfc0e"} Jul 28 17:10:41.784297 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.784221 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:10:41.785642 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.785621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwqnb" event={"ID":"b911fba1-47dc-41b3-b599-c691b72732ab","Type":"ContainerStarted","Data":"cf98a7b7d39d346fafa934de66e1665fefc1c654c01740fe70678a5b4de8914f"} Jul 28 17:10:41.785718 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.785656 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwqnb" event={"ID":"b911fba1-47dc-41b3-b599-c691b72732ab","Type":"ContainerStarted","Data":"30926502a8ed5e49cdf7b64e1972398ea3e47cfb4b0313754d4ff17584df309c"} Jul 28 17:10:41.805948 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.805904 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59994bb6df-zbk7c" podStartSLOduration=2.920235007 podStartE2EDuration="11.805888661s" totalImagesPullingTime="8.885653654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:41.804543661 +0000 UTC m=+75.035136696" watchObservedRunningTime="2026-07-28 17:10:41.805888661 +0000 UTC m=+75.036481699" Jul 28 17:10:41.821660 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.821620 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xwqnb" podStartSLOduration=67.560276806 podStartE2EDuration="1m14.821606294s" totalImagesPullingTime="7.261329488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:41.821023373 +0000 UTC m=+75.051616412" watchObservedRunningTime="2026-07-28 17:10:41.821606294 +0000 UTC m=+75.052199329" Jul 28 17:10:41.835993 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:41.835957 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5p6p7" podStartSLOduration=67.573938945 podStartE2EDuration="1m14.835944787s" totalImagesPullingTime="7.262005842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:41.835607195 +0000 UTC m=+75.066200232" watchObservedRunningTime="2026-07-28 17:10:41.835944787 +0000 UTC m=+75.066537822" Jul 28 17:10:50.570286 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.570175 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pb9rs"] Jul 28 17:10:50.573108 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.573089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.575567 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.575521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 17:10:50.575567 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.575561 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 17:10:50.575832 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.575815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 17:10:50.575885 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.575869 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 17:10:50.575935 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.575914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 17:10:50.576670 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.576654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 17:10:50.576765 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.576702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mdzx4\"" Jul 28 17:10:50.694758 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-wtmp\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-sys\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-root\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-metrics-client-ca\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvqt\" (UniqueName: \"kubernetes.io/projected/4b14174e-bf09-420a-9a32-96da7f5367be-kube-api-access-8cvqt\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.694928 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-textfile\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.695105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-accelerators-collector-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.695105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.694976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796015 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.795986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-wtmp\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796015 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-sys\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-root\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-metrics-client-ca\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-root\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:50.796194 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 17:10:50.796225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-wtmp\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:10:50.796251 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls podName:4b14174e-bf09-420a-9a32-96da7f5367be nodeName:}" failed. No retries permitted until 2026-07-28 17:10:51.29623284 +0000 UTC m=+84.526825857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls") pod "node-exporter-pb9rs" (UID: "4b14174e-bf09-420a-9a32-96da7f5367be") : secret "node-exporter-tls" not found Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796252 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b14174e-bf09-420a-9a32-96da7f5367be-sys\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvqt\" (UniqueName: \"kubernetes.io/projected/4b14174e-bf09-420a-9a32-96da7f5367be-kube-api-access-8cvqt\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-textfile\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-accelerators-collector-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796702 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-textfile\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796702 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-metrics-client-ca\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.796862 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.796844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-accelerators-collector-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.798459 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.798440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:50.806251 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:50.806230 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvqt\" (UniqueName: \"kubernetes.io/projected/4b14174e-bf09-420a-9a32-96da7f5367be-kube-api-access-8cvqt\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:51.300870 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:51.300833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:51.303292 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:51.303269 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b14174e-bf09-420a-9a32-96da7f5367be-node-exporter-tls\") pod \"node-exporter-pb9rs\" (UID: \"4b14174e-bf09-420a-9a32-96da7f5367be\") " pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:51.481931 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:51.481894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pb9rs" Jul 28 17:10:51.493023 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:51.492982 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b14174e_bf09_420a_9a32_96da7f5367be.slice/crio-673cb9b58021fd5d2da0be70a0156826e7aba005b79abe0f54edf026b52f9666 WatchSource:0}: Error finding container 673cb9b58021fd5d2da0be70a0156826e7aba005b79abe0f54edf026b52f9666: Status 404 returned error can't find the container with id 673cb9b58021fd5d2da0be70a0156826e7aba005b79abe0f54edf026b52f9666 Jul 28 17:10:51.819368 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:51.819339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pb9rs" event={"ID":"4b14174e-bf09-420a-9a32-96da7f5367be","Type":"ContainerStarted","Data":"673cb9b58021fd5d2da0be70a0156826e7aba005b79abe0f54edf026b52f9666"} Jul 28 17:10:52.825880 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:52.825848 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b14174e-bf09-420a-9a32-96da7f5367be" containerID="8bc57f2de2508e1471ea0de64b4b571dd80ae8839836eea92cf98be98e89b96c" exitCode=0 Jul 28 17:10:52.826243 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:52.825886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pb9rs" event={"ID":"4b14174e-bf09-420a-9a32-96da7f5367be","Type":"ContainerDied","Data":"8bc57f2de2508e1471ea0de64b4b571dd80ae8839836eea92cf98be98e89b96c"} Jul 28 17:10:53.735947 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:53.735915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bddc5d8db-llrzt" Jul 28 17:10:53.831290 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:53.831259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pb9rs" event={"ID":"4b14174e-bf09-420a-9a32-96da7f5367be","Type":"ContainerStarted","Data":"4209eee8839ba22b70f32d200a4907b250f0284f7c4c830664fe4f8dc16c4c33"} Jul 28 17:10:53.831664 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:53.831308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pb9rs" event={"ID":"4b14174e-bf09-420a-9a32-96da7f5367be","Type":"ContainerStarted","Data":"c7c4f8ac7aad928cbaecb91ce7fa9f14920c15152ed645b83e2ae7a4651749da"} Jul 28 17:10:53.852363 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:53.852317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pb9rs" podStartSLOduration=2.828079934 podStartE2EDuration="3.852303716s" totalImagesPullingTime="962.909954ms" totalInitContainerRuntime="61.313828ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:53.851251524 +0000 UTC m=+87.081844560" watchObservedRunningTime="2026-07-28 17:10:53.852303716 +0000 UTC m=+87.082896730" Jul 28 17:10:56.844323 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.844290 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:10:56.846883 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.846861 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.849897 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.849863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 17:10:56.850043 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.849926 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 17:10:56.850043 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.850010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 17:10:56.850715 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.850691 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 17:10:56.850715 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.850702 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 17:10:56.851120 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851097 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 17:10:56.851249 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851184 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 17:10:56.851249 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-75pdv\"" Jul 28 17:10:56.851249 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 17:10:56.851407 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 17:10:56.851407 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851097 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 17:10:56.851407 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851399 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 17:10:56.851557 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 17:10:56.851557 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851492 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 17:10:56.851650 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:10:56.851836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 17:10:56.851958 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.851942 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1nrjqhv0rtsa6\"" Jul 28 17:10:56.858980 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.858955 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 17:10:56.944612 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944612 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944609 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944692 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.944856 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.944955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945124 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrn9s\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-kube-api-access-jrn9s\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945156 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:56.945450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:56.945257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.045880 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrn9s\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-kube-api-access-jrn9s\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.045880 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.045989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046091 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046376 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046446 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.046964 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.046738 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.047832 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.047804 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049234 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049071 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049234 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049079 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049234 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049157 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049782 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049587 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049782 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.049920 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.049836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.050471 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.050421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.050471 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.050433 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.050835 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.050815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051074 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051045 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051277 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051384 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051506 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051783 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051741 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.051865 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.051821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.052492 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.052473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-config\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.053018 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.053002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.054510 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.054493 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrn9s\" (UniqueName: \"kubernetes.io/projected/1e4d03ae-a9aa-4f1b-a201-1a09e24daad1-kube-api-access-jrn9s\") pod \"prometheus-k8s-0\" (UID: \"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.161760 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.161677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:10:57.304095 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.304063 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 17:10:57.306969 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:10:57.306942 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4d03ae_a9aa_4f1b_a201_1a09e24daad1.slice/crio-750e141a4b2a9b38e08327577f57f416174aa1b9b6f5fbd5591e57e4d5cd37cc WatchSource:0}: Error finding container 750e141a4b2a9b38e08327577f57f416174aa1b9b6f5fbd5591e57e4d5cd37cc: Status 404 returned error can't find the container with id 750e141a4b2a9b38e08327577f57f416174aa1b9b6f5fbd5591e57e4d5cd37cc Jul 28 17:10:57.850503 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:57.850469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"750e141a4b2a9b38e08327577f57f416174aa1b9b6f5fbd5591e57e4d5cd37cc"} Jul 28 17:10:59.859249 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:59.859210 2578 generic.go:356] "Generic (PLEG): container finished" podID="1e4d03ae-a9aa-4f1b-a201-1a09e24daad1" containerID="f9c72f844602ef08931bbacd8111c1e0faf9041137dcbdcf7c9b76c3d63da11c" exitCode=0 Jul 28 17:10:59.859611 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:10:59.859256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerDied","Data":"f9c72f844602ef08931bbacd8111c1e0faf9041137dcbdcf7c9b76c3d63da11c"} Jul 28 17:11:03.875096 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:03.875057 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"e1d6cb7b4240172895b046f509add7adae40b150af92ea4bf34a86f577f3152f"} Jul 28 17:11:03.875573 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:03.875151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"c8cfb0d9f4d5c88154931b43c482ef54bf53f5b0b31826a0cadbe80cba1f401f"} Jul 28 17:11:05.885282 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:05.885251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"6e422590e9fc1968f0726596d5e72106efb60fddf3efc77a803f35c64fe95f56"} Jul 28 17:11:05.885638 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:05.885315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"b5832053ca06651b859cd622689ecf441d5d4092492886828742c46f994362d5"} Jul 28 17:11:05.885638 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:05.885340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"85429533be6244efd85042d0ad4b01658187affd708d23c56b403e67641c8d10"} Jul 28 17:11:05.885638 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:05.885367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e4d03ae-a9aa-4f1b-a201-1a09e24daad1","Type":"ContainerStarted","Data":"27d58b7ef5598c07ad220a817ae6fe9a6e9242993f4143763477143c13c15fc5"} Jul 28 17:11:05.923557 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:05.923495 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.434383589 podStartE2EDuration="9.923473009s" totalImagesPullingTime="7.463297748s" totalInitContainerRuntime="25.791672ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:05.921574103 +0000 UTC m=+99.152167151" watchObservedRunningTime="2026-07-28 17:11:05.923473009 +0000 UTC m=+99.154066045" Jul 28 17:11:07.162777 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:07.162739 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:11:12.792031 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:12.791995 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5p6p7" Jul 28 17:11:18.143255 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:18.143222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfwh9_59db2eca-ec1b-4103-8d0d-dcee0f03d5e5/serve-healthcheck-canary/0.log" Jul 28 17:11:57.162888 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:57.162856 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:11:57.181409 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:57.181384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:11:58.075386 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:11:58.075353 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 17:14:27.170171 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:14:27.170126 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 17:17:05.764318 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.764283 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-4v5r8"] Jul 28 17:17:05.766450 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.766434 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.769024 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.769001 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 28 17:17:05.769168 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.769115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 28 17:17:05.769168 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.769127 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 28 17:17:05.770215 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.770199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vxh6m\"" Jul 28 17:17:05.778005 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.777978 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4v5r8"] Jul 28 17:17:05.876905 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.876873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.877073 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.876937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45s49\" (UniqueName: \"kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.977727 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.977695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45s49\" (UniqueName: \"kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.977883 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.977787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.978176 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.978159 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:05.986876 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:05.986852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45s49\" (UniqueName: \"kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49\") pod \"s3-init-4v5r8\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " pod="kserve/s3-init-4v5r8" Jul 28 17:17:06.074892 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:06.074863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4v5r8" Jul 28 17:17:06.196209 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:06.196175 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-4v5r8"] Jul 28 17:17:06.200981 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:17:06.200949 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb14413_31b9_4fb8_85c5_c84a77439995.slice/crio-cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc WatchSource:0}: Error finding container cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc: Status 404 returned error can't find the container with id cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc Jul 28 17:17:06.202779 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:06.202758 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:17:07.088479 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:07.088442 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerStarted","Data":"cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc"} Jul 28 17:17:10.101718 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:10.101687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerStarted","Data":"3c8f082d8d31b6e7f5037206bb003bb8b8e71f7ea764b54b65ed7fb1c97a7fda"} Jul 28 17:17:14.117625 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:14.117590 2578 generic.go:356] "Generic (PLEG): container finished" podID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerID="3c8f082d8d31b6e7f5037206bb003bb8b8e71f7ea764b54b65ed7fb1c97a7fda" exitCode=0 Jul 28 17:17:14.118108 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:14.117674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerDied","Data":"3c8f082d8d31b6e7f5037206bb003bb8b8e71f7ea764b54b65ed7fb1c97a7fda"} Jul 28 17:17:19.140343 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:19.140258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerStarted","Data":"7bdc2c3c4e688903047a7eee4c655046485f5c29ae1a8e369d7a52bd57f564ad"} Jul 28 17:17:19.158822 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:17:19.158765 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-4v5r8" podStartSLOduration=2.137927241 podStartE2EDuration="14.158750646s" totalImagesPullingTime="7.851340148s" totalInitContainerRuntime="4.169483257s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:19.157438599 +0000 UTC m=+472.388031668" watchObservedRunningTime="2026-07-28 17:17:19.158750646 +0000 UTC m=+472.389343684" Jul 28 17:18:24.361107 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:24.361069 2578 generic.go:356] "Generic (PLEG): container finished" podID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerID="7bdc2c3c4e688903047a7eee4c655046485f5c29ae1a8e369d7a52bd57f564ad" exitCode=0 Jul 28 17:18:24.361107 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:24.361107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerDied","Data":"7bdc2c3c4e688903047a7eee4c655046485f5c29ae1a8e369d7a52bd57f564ad"} Jul 28 17:18:25.489790 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.489766 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4v5r8" Jul 28 17:18:25.590372 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.590337 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45s49\" (UniqueName: \"kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49\") pod \"bfb14413-31b9-4fb8-85c5-c84a77439995\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " Jul 28 17:18:25.590372 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.590378 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache\") pod \"bfb14413-31b9-4fb8-85c5-c84a77439995\" (UID: \"bfb14413-31b9-4fb8-85c5-c84a77439995\") " Jul 28 17:18:25.592481 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.592452 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49" (OuterVolumeSpecName: "kube-api-access-45s49") pod "bfb14413-31b9-4fb8-85c5-c84a77439995" (UID: "bfb14413-31b9-4fb8-85c5-c84a77439995"). InnerVolumeSpecName "kube-api-access-45s49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:18:25.609511 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.609486 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfb14413-31b9-4fb8-85c5-c84a77439995" (UID: "bfb14413-31b9-4fb8-85c5-c84a77439995"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:18:25.691189 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.691121 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45s49\" (UniqueName: \"kubernetes.io/projected/bfb14413-31b9-4fb8-85c5-c84a77439995-kube-api-access-45s49\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:18:25.691189 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:25.691157 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfb14413-31b9-4fb8-85c5-c84a77439995-model-cache\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:18:26.369600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:26.369570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-4v5r8" event={"ID":"bfb14413-31b9-4fb8-85c5-c84a77439995","Type":"ContainerDied","Data":"cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc"} Jul 28 17:18:26.369600 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:26.369603 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbcd4d7ced5e150dc1defc413ae5664718d3ec5f43bbb04ebe7f0093121792bc" Jul 28 17:18:26.369789 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:18:26.369604 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-4v5r8" Jul 28 17:32:01.077395 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077320 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:32:01.079360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077594 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerName="s3-init" Jul 28 17:32:01.079360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077604 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerName="s3-init" Jul 28 17:32:01.079360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077619 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerName="download-hf-model" Jul 28 17:32:01.079360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077625 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerName="download-hf-model" Jul 28 17:32:01.079360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.077669 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfb14413-31b9-4fb8-85c5-c84a77439995" containerName="s3-init" Jul 28 17:32:01.080692 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.080677 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.083070 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.083045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 17:32:01.083308 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.083290 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 17:32:01.083554 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.083542 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 17:32:01.084705 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.084680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Jul 28 17:32:01.084831 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.084734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-klwxk\"" Jul 28 17:32:01.084831 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.084736 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Jul 28 17:32:01.084831 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.084777 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:32:01.090836 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.090814 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:32:01.137954 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.137924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.138105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.137963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6tn\" (UniqueName: \"kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.138105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.138003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.138105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.138020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.138105 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.138052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239221 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6tn\" (UniqueName: \"kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239415 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239415 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239415 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239415 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.239661 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.240015 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.239993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.240104 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.240028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.241724 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.241706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.248482 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.248460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6tn\" (UniqueName: \"kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn\") pod \"isvc-canary-promote-v2-predictor-f69c9c758-95bkm\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.391328 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.391246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:01.516672 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:01.516520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:32:01.519311 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:32:01.519283 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8863fab_66e5_421b_a4da_8a1883e10838.slice/crio-f49519168b10190ad3dea8c5379ccc5b67a9192b850d166beee5632a4f4a12a1 WatchSource:0}: Error finding container f49519168b10190ad3dea8c5379ccc5b67a9192b850d166beee5632a4f4a12a1: Status 404 returned error can't find the container with id f49519168b10190ad3dea8c5379ccc5b67a9192b850d166beee5632a4f4a12a1 Jul 28 17:32:02.129784 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:02.129745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerStarted","Data":"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3"} Jul 28 17:32:02.130251 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:02.129804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerStarted","Data":"f49519168b10190ad3dea8c5379ccc5b67a9192b850d166beee5632a4f4a12a1"} Jul 28 17:32:06.145590 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:06.145555 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8863fab-66e5-421b-a4da-8a1883e10838" containerID="9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3" exitCode=0 Jul 28 17:32:06.145978 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:06.145627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerDied","Data":"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3"} Jul 28 17:32:06.146722 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:06.146709 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 17:32:19.203386 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:19.203349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerStarted","Data":"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e"} Jul 28 17:32:22.216976 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:22.216944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerStarted","Data":"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45"} Jul 28 17:32:22.217390 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:22.217034 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:22.239106 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:22.239059 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podStartSLOduration=2.2275565999999998 podStartE2EDuration="21.239046816s" totalImagesPullingTime="15.111652695s" totalInitContainerRuntime="3.899837521s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:32:22.23870034 +0000 UTC m=+1375.469293377" watchObservedRunningTime="2026-07-28 17:32:22.239046816 +0000 UTC m=+1375.469639898" Jul 28 17:32:23.221258 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:23.221227 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:23.222377 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:23.222345 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:32:24.224629 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:24.224591 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:32:29.229886 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:29.229856 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:32:29.230473 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:29.230446 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:32:39.231047 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:39.231008 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:32:49.231042 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:49.231000 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:32:59.230598 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:32:59.230555 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:33:09.230824 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:09.230781 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:33:19.231151 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:19.231048 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:33:29.231256 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:29.231216 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.14:8080: connect: connection refused" Jul 28 17:33:39.230990 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:39.230960 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:33:41.295317 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:41.295285 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:33:41.295754 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:41.295522 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" containerID="cri-o://35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e" gracePeriod=30 Jul 28 17:33:41.295754 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:41.295571 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kube-rbac-proxy" containerID="cri-o://34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45" gracePeriod=30 Jul 28 17:33:41.490522 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:41.490483 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8863fab-66e5-421b-a4da-8a1883e10838" containerID="34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45" exitCode=2 Jul 28 17:33:41.490522 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:41.490522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerDied","Data":"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45"} Jul 28 17:33:44.225123 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:44.225060 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.14:8643/healthz\": dial tcp 10.134.0.14:8643: connect: connection refused" Jul 28 17:33:46.235279 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.235256 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:33:46.271402 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271375 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq6tn\" (UniqueName: \"kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn\") pod \"d8863fab-66e5-421b-a4da-8a1883e10838\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " Jul 28 17:33:46.271549 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271419 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls\") pod \"d8863fab-66e5-421b-a4da-8a1883e10838\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " Jul 28 17:33:46.271549 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271463 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert\") pod \"d8863fab-66e5-421b-a4da-8a1883e10838\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " Jul 28 17:33:46.271549 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271498 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config\") pod \"d8863fab-66e5-421b-a4da-8a1883e10838\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " Jul 28 17:33:46.271671 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271551 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location\") pod \"d8863fab-66e5-421b-a4da-8a1883e10838\" (UID: \"d8863fab-66e5-421b-a4da-8a1883e10838\") " Jul 28 17:33:46.271843 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271799 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d8863fab-66e5-421b-a4da-8a1883e10838" (UID: "d8863fab-66e5-421b-a4da-8a1883e10838"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:33:46.271946 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271913 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d8863fab-66e5-421b-a4da-8a1883e10838" (UID: "d8863fab-66e5-421b-a4da-8a1883e10838"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:33:46.272002 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.271948 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d8863fab-66e5-421b-a4da-8a1883e10838" (UID: "d8863fab-66e5-421b-a4da-8a1883e10838"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:33:46.273684 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.273651 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn" (OuterVolumeSpecName: "kube-api-access-bq6tn") pod "d8863fab-66e5-421b-a4da-8a1883e10838" (UID: "d8863fab-66e5-421b-a4da-8a1883e10838"). InnerVolumeSpecName "kube-api-access-bq6tn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:33:46.273939 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.273919 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d8863fab-66e5-421b-a4da-8a1883e10838" (UID: "d8863fab-66e5-421b-a4da-8a1883e10838"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:33:46.372281 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.372250 2578 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d8863fab-66e5-421b-a4da-8a1883e10838-kserve-provision-location\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:33:46.372281 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.372281 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq6tn\" (UniqueName: \"kubernetes.io/projected/d8863fab-66e5-421b-a4da-8a1883e10838-kube-api-access-bq6tn\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:33:46.372468 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.372291 2578 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d8863fab-66e5-421b-a4da-8a1883e10838-proxy-tls\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:33:46.372468 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.372300 2578 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-cabundle-cert\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:33:46.372468 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.372308 2578 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d8863fab-66e5-421b-a4da-8a1883e10838-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:33:46.509914 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.509870 2578 generic.go:356] "Generic (PLEG): container finished" podID="d8863fab-66e5-421b-a4da-8a1883e10838" containerID="35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e" exitCode=0 Jul 28 17:33:46.509914 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.509916 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerDied","Data":"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e"} Jul 28 17:33:46.510227 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.509929 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" Jul 28 17:33:46.510227 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.509983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm" event={"ID":"d8863fab-66e5-421b-a4da-8a1883e10838","Type":"ContainerDied","Data":"f49519168b10190ad3dea8c5379ccc5b67a9192b850d166beee5632a4f4a12a1"} Jul 28 17:33:46.510227 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.510038 2578 scope.go:117] "RemoveContainer" containerID="34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45" Jul 28 17:33:46.518722 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.518704 2578 scope.go:117] "RemoveContainer" containerID="35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e" Jul 28 17:33:46.526071 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.526052 2578 scope.go:117] "RemoveContainer" containerID="9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3" Jul 28 17:33:46.533159 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533127 2578 scope.go:117] "RemoveContainer" containerID="34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45" Jul 28 17:33:46.533482 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:33:46.533458 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45\": container with ID starting with 34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45 not found: ID does not exist" containerID="34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45" Jul 28 17:33:46.533537 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533493 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45"} err="failed to get container status \"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45\": rpc error: code = NotFound desc = could not find container \"34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45\": container with ID starting with 34fb525301a366793a52fe8c71fd752dd47530ec4e5bce06adbeb59c287ffd45 not found: ID does not exist" Jul 28 17:33:46.533537 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533526 2578 scope.go:117] "RemoveContainer" containerID="35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e" Jul 28 17:33:46.533757 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:33:46.533743 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e\": container with ID starting with 35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e not found: ID does not exist" containerID="35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e" Jul 28 17:33:46.533798 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533762 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e"} err="failed to get container status \"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e\": rpc error: code = NotFound desc = could not find container \"35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e\": container with ID starting with 35100c0dd3b08cb312b704171eeab61aae86b11f447033ca06f51c4c44999c3e not found: ID does not exist" Jul 28 17:33:46.533798 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533775 2578 scope.go:117] "RemoveContainer" containerID="9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3" Jul 28 17:33:46.533961 ip-10-0-139-137 kubenswrapper[2578]: E0728 17:33:46.533943 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3\": container with ID starting with 9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3 not found: ID does not exist" containerID="9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3" Jul 28 17:33:46.534004 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.533972 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3"} err="failed to get container status \"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3\": rpc error: code = NotFound desc = could not find container \"9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3\": container with ID starting with 9f95d43ba099c58dd0f420e3cfababb2147086f820878d338344646aa0859da3 not found: ID does not exist" Jul 28 17:33:46.537076 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.537050 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:33:46.543117 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:46.543095 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-f69c9c758-95bkm"] Jul 28 17:33:47.396519 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:33:47.396484 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" path="/var/lib/kubelet/pods/d8863fab-66e5-421b-a4da-8a1883e10838/volumes" Jul 28 17:35:16.609338 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609247 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609539 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="storage-initializer" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609552 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="storage-initializer" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609577 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609583 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609590 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kube-rbac-proxy" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609595 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kube-rbac-proxy" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609634 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kube-rbac-proxy" Jul 28 17:35:16.610173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.609643 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8863fab-66e5-421b-a4da-8a1883e10838" containerName="kserve-container" Jul 28 17:35:16.612869 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.612848 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.615436 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.615398 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Jul 28 17:35:16.615566 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.615430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 28 17:35:16.615566 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.615463 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 28 17:35:16.615566 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.615404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 28 17:35:16.615731 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.615656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\"" Jul 28 17:35:16.616456 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.616437 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-klwxk\"" Jul 28 17:35:16.616572 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.616458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 28 17:35:16.623227 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.623206 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:35:16.635991 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.635970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.636121 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.636007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.636121 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.636037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.636121 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.636058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.636121 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.636079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz26t\" (UniqueName: \"kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737266 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737444 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737444 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737444 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737444 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz26t\" (UniqueName: \"kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737711 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.737949 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.737930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.738100 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.738080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.739701 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.739678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.747847 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.747815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz26t\" (UniqueName: \"kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t\") pod \"isvc-canary-rollback-predictor-b4645bb5c-bj66w\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:16.926464 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:16.926374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:17.051691 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:17.051669 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:35:17.054491 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:35:17.054463 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec6076c_8744_44fa_8d45_7f110d1779c3.slice/crio-a05442eebf930a734ffeff57da0e6a0b3aa41c71841ddc2b8a71d11470c3d302 WatchSource:0}: Error finding container a05442eebf930a734ffeff57da0e6a0b3aa41c71841ddc2b8a71d11470c3d302: Status 404 returned error can't find the container with id a05442eebf930a734ffeff57da0e6a0b3aa41c71841ddc2b8a71d11470c3d302 Jul 28 17:35:17.823279 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:17.823245 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerStarted","Data":"76048e0c86272eaca39c7c0c715c1f72d0ef9138520766d4a4e0fa8ccc662156"} Jul 28 17:35:17.823774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:17.823315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerStarted","Data":"a05442eebf930a734ffeff57da0e6a0b3aa41c71841ddc2b8a71d11470c3d302"} Jul 28 17:35:21.838620 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:21.838591 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerID="76048e0c86272eaca39c7c0c715c1f72d0ef9138520766d4a4e0fa8ccc662156" exitCode=0 Jul 28 17:35:21.839072 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:21.838644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerDied","Data":"76048e0c86272eaca39c7c0c715c1f72d0ef9138520766d4a4e0fa8ccc662156"} Jul 28 17:35:22.844771 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:22.844731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerStarted","Data":"410975ea9144e28efadbd194d602625821bb5349d3036578ea6f5c84433e2ad6"} Jul 28 17:35:22.845225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:22.844792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerStarted","Data":"92e237276ab0a611205f1633875d6df6e7bfd7ee326e7b7bc5c34cedbe7b1302"} Jul 28 17:35:22.845225 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:22.844989 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:22.866786 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:22.866736 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podStartSLOduration=3.091620507 podStartE2EDuration="6.866718594s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.775098087s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:35:22.865313235 +0000 UTC m=+1556.095906273" watchObservedRunningTime="2026-07-28 17:35:22.866718594 +0000 UTC m=+1556.097311630" Jul 28 17:35:23.848321 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:23.848287 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:23.849361 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:23.849336 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:35:24.851569 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:24.851520 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:35:29.856627 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:29.856596 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:35:29.857166 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:29.857124 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:35:39.858023 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:39.857985 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:35:49.857895 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:49.857850 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:35:59.857529 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:35:59.857488 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:36:09.857205 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:09.857165 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:36:19.857387 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:19.857295 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:36:29.857045 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:29.857000 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.15:8080: connect: connection refused" Jul 28 17:36:35.400331 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:35.400302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:36:36.653796 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:36.653759 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:36:37.104783 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:37.104726 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" containerID="cri-o://92e237276ab0a611205f1633875d6df6e7bfd7ee326e7b7bc5c34cedbe7b1302" gracePeriod=30 Jul 28 17:36:37.104968 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:37.104745 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kube-rbac-proxy" containerID="cri-o://410975ea9144e28efadbd194d602625821bb5349d3036578ea6f5c84433e2ad6" gracePeriod=30 Jul 28 17:36:38.109887 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:38.109857 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerID="410975ea9144e28efadbd194d602625821bb5349d3036578ea6f5c84433e2ad6" exitCode=2 Jul 28 17:36:38.110271 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:38.109911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerDied","Data":"410975ea9144e28efadbd194d602625821bb5349d3036578ea6f5c84433e2ad6"} Jul 28 17:36:39.852500 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:39.852457 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.15:8643/healthz\": dial tcp 10.134.0.15:8643: connect: connection refused" Jul 28 17:36:42.125865 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.125834 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerID="92e237276ab0a611205f1633875d6df6e7bfd7ee326e7b7bc5c34cedbe7b1302" exitCode=0 Jul 28 17:36:42.126231 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.125884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerDied","Data":"92e237276ab0a611205f1633875d6df6e7bfd7ee326e7b7bc5c34cedbe7b1302"} Jul 28 17:36:42.246510 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.246484 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:36:42.302608 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302563 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls\") pod \"8ec6076c-8744-44fa-8d45-7f110d1779c3\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " Jul 28 17:36:42.302608 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302620 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location\") pod \"8ec6076c-8744-44fa-8d45-7f110d1779c3\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " Jul 28 17:36:42.302866 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302644 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config\") pod \"8ec6076c-8744-44fa-8d45-7f110d1779c3\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " Jul 28 17:36:42.302866 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302671 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz26t\" (UniqueName: \"kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t\") pod \"8ec6076c-8744-44fa-8d45-7f110d1779c3\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " Jul 28 17:36:42.302866 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302688 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert\") pod \"8ec6076c-8744-44fa-8d45-7f110d1779c3\" (UID: \"8ec6076c-8744-44fa-8d45-7f110d1779c3\") " Jul 28 17:36:42.303023 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.302977 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8ec6076c-8744-44fa-8d45-7f110d1779c3" (UID: "8ec6076c-8744-44fa-8d45-7f110d1779c3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 17:36:42.303173 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.303129 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8ec6076c-8744-44fa-8d45-7f110d1779c3" (UID: "8ec6076c-8744-44fa-8d45-7f110d1779c3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:42.303268 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.303188 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8ec6076c-8744-44fa-8d45-7f110d1779c3" (UID: "8ec6076c-8744-44fa-8d45-7f110d1779c3"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 17:36:42.305289 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.305266 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8ec6076c-8744-44fa-8d45-7f110d1779c3" (UID: "8ec6076c-8744-44fa-8d45-7f110d1779c3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 17:36:42.305377 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.305268 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t" (OuterVolumeSpecName: "kube-api-access-bz26t") pod "8ec6076c-8744-44fa-8d45-7f110d1779c3" (UID: "8ec6076c-8744-44fa-8d45-7f110d1779c3"). InnerVolumeSpecName "kube-api-access-bz26t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 17:36:42.403512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.403473 2578 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ec6076c-8744-44fa-8d45-7f110d1779c3-kserve-provision-location\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:36:42.403512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.403505 2578 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:36:42.403512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.403514 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz26t\" (UniqueName: \"kubernetes.io/projected/8ec6076c-8744-44fa-8d45-7f110d1779c3-kube-api-access-bz26t\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:36:42.403512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.403524 2578 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ec6076c-8744-44fa-8d45-7f110d1779c3-cabundle-cert\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:36:42.403997 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:42.403533 2578 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ec6076c-8744-44fa-8d45-7f110d1779c3-proxy-tls\") on node \"ip-10-0-139-137.ec2.internal\" DevicePath \"\"" Jul 28 17:36:43.131294 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.131260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" event={"ID":"8ec6076c-8744-44fa-8d45-7f110d1779c3","Type":"ContainerDied","Data":"a05442eebf930a734ffeff57da0e6a0b3aa41c71841ddc2b8a71d11470c3d302"} Jul 28 17:36:43.131294 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.131298 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w" Jul 28 17:36:43.131783 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.131335 2578 scope.go:117] "RemoveContainer" containerID="410975ea9144e28efadbd194d602625821bb5349d3036578ea6f5c84433e2ad6" Jul 28 17:36:43.139770 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.139745 2578 scope.go:117] "RemoveContainer" containerID="92e237276ab0a611205f1633875d6df6e7bfd7ee326e7b7bc5c34cedbe7b1302" Jul 28 17:36:43.147741 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.147721 2578 scope.go:117] "RemoveContainer" containerID="76048e0c86272eaca39c7c0c715c1f72d0ef9138520766d4a4e0fa8ccc662156" Jul 28 17:36:43.158126 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.158083 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:36:43.159909 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.159881 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-b4645bb5c-bj66w"] Jul 28 17:36:43.397416 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:36:43.397336 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" path="/var/lib/kubelet/pods/8ec6076c-8744-44fa-8d45-7f110d1779c3/volumes" Jul 28 17:44:26.051789 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:26.051760 2578 ???:1] "http: TLS handshake error from 10.0.138.17:54088: EOF" Jul 28 17:44:26.057735 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:26.057711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mh8sc_adf1f37f-20c2-460e-8af2-f63b45d86d84/global-pull-secret-syncer/0.log" Jul 28 17:44:26.160788 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:26.160759 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-brzzl_2e818681-cf9b-4524-baa8-ec22c1932954/konnectivity-agent/0.log" Jul 28 17:44:26.286395 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:26.286365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-137.ec2.internal_d1def7bac9bf493198849b5b9d9d19c5/haproxy/0.log" Jul 28 17:44:30.436181 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.436092 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pb9rs_4b14174e-bf09-420a-9a32-96da7f5367be/node-exporter/0.log" Jul 28 17:44:30.464171 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.464099 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pb9rs_4b14174e-bf09-420a-9a32-96da7f5367be/kube-rbac-proxy/0.log" Jul 28 17:44:30.494421 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.494397 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pb9rs_4b14174e-bf09-420a-9a32-96da7f5367be/init-textfile/0.log" Jul 28 17:44:30.745501 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.745416 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/prometheus/0.log" Jul 28 17:44:30.774181 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.774128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/config-reloader/0.log" Jul 28 17:44:30.806756 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.806723 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/thanos-sidecar/0.log" Jul 28 17:44:30.830733 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.830700 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/kube-rbac-proxy-web/0.log" Jul 28 17:44:30.858801 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.858781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/kube-rbac-proxy/0.log" Jul 28 17:44:30.888862 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.888835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/kube-rbac-proxy-thanos/0.log" Jul 28 17:44:30.914944 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:30.914917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1e4d03ae-a9aa-4f1b-a201-1a09e24daad1/init-config-reloader/0.log" Jul 28 17:44:34.295313 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295278 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598"] Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295555 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kube-rbac-proxy" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295571 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kube-rbac-proxy" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295589 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295598 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295609 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="storage-initializer" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295618 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="storage-initializer" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295663 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kserve-container" Jul 28 17:44:34.295774 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.295670 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec6076c-8744-44fa-8d45-7f110d1779c3" containerName="kube-rbac-proxy" Jul 28 17:44:34.298443 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.298429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.300844 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.300814 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"openshift-service-ca.crt\"" Jul 28 17:44:34.301998 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.301979 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-spfd9\"/\"kube-root-ca.crt\"" Jul 28 17:44:34.302099 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.302006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-spfd9\"/\"default-dockercfg-992qv\"" Jul 28 17:44:34.306603 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.306579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598"] Jul 28 17:44:34.407290 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.407254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-proc\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.407290 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.407298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9rr\" (UniqueName: \"kubernetes.io/projected/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-kube-api-access-dw9rr\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.407512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.407369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-sys\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.407512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.407390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-lib-modules\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.407512 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.407405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-podres\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508210 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-sys\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508210 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-lib-modules\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508418 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-sys\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508418 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-podres\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508418 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-lib-modules\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508418 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-proc\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508418 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9rr\" (UniqueName: \"kubernetes.io/projected/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-kube-api-access-dw9rr\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508565 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-podres\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.508565 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.508475 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-proc\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.516179 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.516152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9rr\" (UniqueName: \"kubernetes.io/projected/0bc4cb2c-4fa1-465d-bdbe-83a0ac092058-kube-api-access-dw9rr\") pod \"perf-node-gather-daemonset-g8598\" (UID: \"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058\") " pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.608266 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.608236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:34.740919 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:34.740888 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598"] Jul 28 17:44:34.745605 ip-10-0-139-137 kubenswrapper[2578]: W0728 17:44:34.745577 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0bc4cb2c_4fa1_465d_bdbe_83a0ac092058.slice/crio-dbcefedb1c0aa4886c17e7b808a67beb7880fba397233894b1234cf1b9bcf055 WatchSource:0}: Error finding container dbcefedb1c0aa4886c17e7b808a67beb7880fba397233894b1234cf1b9bcf055: Status 404 returned error can't find the container with id dbcefedb1c0aa4886c17e7b808a67beb7880fba397233894b1234cf1b9bcf055 Jul 28 17:44:35.126373 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.126287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dcn54_33ae3487-72a9-47f6-8984-f6bb5a886904/dns/0.log" Jul 28 17:44:35.150248 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.150215 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dcn54_33ae3487-72a9-47f6-8984-f6bb5a886904/kube-rbac-proxy/0.log" Jul 28 17:44:35.313202 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.313170 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5hvm_c9d07d5e-697e-4ea7-8152-71f3f809d854/dns-node-resolver/0.log" Jul 28 17:44:35.715169 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.715110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" event={"ID":"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058","Type":"ContainerStarted","Data":"d9692cab3d7cf573aec7ea9ab1670dbd28f7852237e29e602e04793e23331293"} Jul 28 17:44:35.715349 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.715193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" event={"ID":"0bc4cb2c-4fa1-465d-bdbe-83a0ac092058","Type":"ContainerStarted","Data":"dbcefedb1c0aa4886c17e7b808a67beb7880fba397233894b1234cf1b9bcf055"} Jul 28 17:44:35.715349 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.715222 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:35.731666 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.731617 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" podStartSLOduration=1.7315986859999999 podStartE2EDuration="1.731598686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:44:35.731062851 +0000 UTC m=+2108.961655898" watchObservedRunningTime="2026-07-28 17:44:35.731598686 +0000 UTC m=+2108.962191723" Jul 28 17:44:35.843022 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.842990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bddc5d8db-llrzt_6a52ce28-58e1-43da-a242-e67422adb356/registry/0.log" Jul 28 17:44:35.921599 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:35.921573 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlw78_3a7b7404-0732-4571-88aa-d47a794ff392/node-ca/0.log" Jul 28 17:44:37.007352 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:37.007326 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bfwh9_59db2eca-ec1b-4103-8d0d-dcee0f03d5e5/serve-healthcheck-canary/0.log" Jul 28 17:44:37.634517 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:37.634486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpdnk_d118381d-e8ad-4eb4-afbf-7cc5c1f69888/kube-rbac-proxy/0.log" Jul 28 17:44:37.662000 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:37.661971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpdnk_d118381d-e8ad-4eb4-afbf-7cc5c1f69888/exporter/0.log" Jul 28 17:44:37.686126 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:37.686103 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpdnk_d118381d-e8ad-4eb4-afbf-7cc5c1f69888/extractor/0.log" Jul 28 17:44:40.176577 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:40.176549 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-4v5r8_bfb14413-31b9-4fb8-85c5-c84a77439995/s3-init/0.log" Jul 28 17:44:40.195978 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:40.195947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-4v5r8_bfb14413-31b9-4fb8-85c5-c84a77439995/download-hf-model/0.log" Jul 28 17:44:41.727519 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:41.727486 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-spfd9/perf-node-gather-daemonset-g8598" Jul 28 17:44:44.634696 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:44.634663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cktc7_81c64da5-ca18-427e-9f36-7d62e054a5fb/migrator/0.log" Jul 28 17:44:44.657678 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:44.657656 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-cktc7_81c64da5-ca18-427e-9f36-7d62e054a5fb/graceful-termination/0.log" Jul 28 17:44:46.042332 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.042302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/kube-multus-additional-cni-plugins/0.log" Jul 28 17:44:46.068700 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.068659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/egress-router-binary-copy/0.log" Jul 28 17:44:46.093876 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.093851 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/cni-plugins/0.log" Jul 28 17:44:46.126022 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.125995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/bond-cni-plugin/0.log" Jul 28 17:44:46.151491 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.151459 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/routeoverride-cni/0.log" Jul 28 17:44:46.175039 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.175009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/whereabouts-cni-bincopy/0.log" Jul 28 17:44:46.198882 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.198856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9n74f_593a8963-dd81-4653-8b79-1f4769b6e1ef/whereabouts-cni/0.log" Jul 28 17:44:46.606215 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.606175 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d54wp_0d2fe370-6ed4-4801-83f5-db007534479e/kube-multus/0.log" Jul 28 17:44:46.721277 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.721240 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xwqnb_b911fba1-47dc-41b3-b599-c691b72732ab/network-metrics-daemon/0.log" Jul 28 17:44:46.746101 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:46.746070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xwqnb_b911fba1-47dc-41b3-b599-c691b72732ab/kube-rbac-proxy/0.log" Jul 28 17:44:47.624348 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.624319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/ovn-controller/0.log" Jul 28 17:44:47.647263 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.647237 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/ovn-acl-logging/0.log" Jul 28 17:44:47.675360 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.675340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/kube-rbac-proxy-node/0.log" Jul 28 17:44:47.698245 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.698219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 17:44:47.720445 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.720422 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/northd/0.log" Jul 28 17:44:47.748740 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.748721 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/nbdb/0.log" Jul 28 17:44:47.772778 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.772760 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/sbdb/0.log" Jul 28 17:44:47.827233 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:47.827211 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvf9w_d396dde0-7e09-4fd7-a1b6-de7026b3e986/ovnkube-controller/0.log" Jul 28 17:44:49.378987 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:49.378954 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5p6p7_e20f1528-fe02-455e-8508-17550d8ef947/network-check-target-container/0.log" Jul 28 17:44:50.452384 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:50.452354 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-kb448_a79f93a6-24d2-4367-bbd0-63ebadac002b/iptables-alerter/0.log" Jul 28 17:44:51.217180 ip-10-0-139-137 kubenswrapper[2578]: I0728 17:44:51.217147 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rzn7b_ae967b17-a854-48df-9078-e84ba362146e/tuned/0.log"