Jul 09 13:22:29.308309 ip-10-0-128-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 13:22:29.308319 ip-10-0-128-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 13:22:29.308328 ip-10-0-128-102 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 13:22:29.308636 ip-10-0-128-102 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 13:22:39.320744 ip-10-0-128-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 13:22:39.320760 ip-10-0-128-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 39d937e8326044c295e12b825b891283 -- Jul 09 13:24:37.907864 ip-10-0-128-102 systemd[1]: Starting Kubernetes Kubelet... Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.324273 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327761 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327774 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327778 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327781 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327784 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327789 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327791 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.365371 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327794 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327796 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327799 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327802 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327805 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327808 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327811 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327813 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327816 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327819 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327822 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327825 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327827 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327838 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327841 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327843 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327846 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327849 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327851 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327854 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.366267 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327856 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327859 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327862 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327864 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327867 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327869 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327872 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327874 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327877 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327880 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327882 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327885 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327887 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327889 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327892 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327895 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327897 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327899 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327902 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327904 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.368469 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327907 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327909 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327912 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327915 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327918 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327921 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327924 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327927 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327930 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327932 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327935 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327937 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327939 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327942 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327944 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327947 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327949 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327952 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327954 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.369312 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327957 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327961 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327964 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327966 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327968 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327971 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327974 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327977 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327979 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327982 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327984 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327986 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327989 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327993 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.327996 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328001 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328005 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328008 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328011 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.372137 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328015 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328020 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328024 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328027 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328030 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328034 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328038 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328041 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328044 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328046 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328049 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328051 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328054 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328057 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328787 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328795 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328798 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328801 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328803 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.372958 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328807 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328809 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328812 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328814 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328818 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328821 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328824 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328827 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328830 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328833 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328836 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328838 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328841 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328844 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328847 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328849 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328852 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328855 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328857 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328860 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.376168 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328862 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328865 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328868 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328870 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328873 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328877 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328882 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328886 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328889 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328894 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328897 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328900 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328902 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328906 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328908 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328911 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328913 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328916 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328919 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.376976 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328922 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328925 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328927 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328930 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328933 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328937 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328941 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328944 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328946 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328949 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328952 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328955 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328958 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328961 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328963 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328967 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328971 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328974 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328976 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.380602 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328979 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328981 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328984 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328987 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328989 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328991 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328994 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.328997 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329007 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329010 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329012 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329015 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329018 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329020 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329023 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329026 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329028 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329031 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329033 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329036 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.381374 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329039 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329041 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329043 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329046 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329049 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329052 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329054 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329057 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329084 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329088 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329092 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329095 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329097 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329100 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329103 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329106 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329509 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329530 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329535 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329538 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.386024 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329542 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329545 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329550 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329553 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329557 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329560 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329563 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329566 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329569 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329572 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329574 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329577 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329579 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329582 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329585 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329587 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329590 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329593 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329596 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329599 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.386816 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329601 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329604 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329606 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329609 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329611 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329614 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329617 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329619 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329622 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329625 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329628 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329630 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329633 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329636 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329639 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329641 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329644 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329646 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329649 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329651 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.391279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329653 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329656 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329658 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329661 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329663 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329666 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329668 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329671 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329674 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329676 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329679 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329682 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329684 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329687 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329689 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329692 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329695 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329697 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329700 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.392279 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329702 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.392980 ip-10-0-128-102 systemd[1]: Started Kubernetes Kubelet. Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329705 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329708 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329711 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329713 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329716 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329718 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329721 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329723 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329726 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329728 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329731 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329733 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329737 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329741 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329744 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329747 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329749 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329752 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329754 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.396485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329757 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329759 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329761 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329764 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329767 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329769 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329772 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329775 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329777 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329780 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329782 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329786 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329789 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329792 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329795 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.329797 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329865 2586 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329872 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329878 2586 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329886 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 13:24:38.398324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329895 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329899 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329904 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329908 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329912 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329915 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329919 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329922 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329925 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329928 2586 flags.go:64] FLAG: --cgroup-root="" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329932 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329935 2586 flags.go:64] FLAG: --client-ca-file="" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329938 2586 flags.go:64] FLAG: --cloud-provider="external" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329941 2586 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329948 2586 flags.go:64] FLAG: --cluster-domain="" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329951 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329954 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329958 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329961 2586 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329965 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329968 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329972 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329975 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329978 2586 flags.go:64] FLAG: --contention-profiling="false" Jul 09 13:24:38.401528 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329981 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329984 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329987 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329990 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329994 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.329999 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330002 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330005 2586 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330008 2586 flags.go:64] FLAG: --enable-server="true" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330012 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330016 2586 flags.go:64] FLAG: --event-burst="100" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330019 2586 flags.go:64] FLAG: --event-qps="50" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330022 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330025 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330028 2586 flags.go:64] FLAG: --eviction-hard="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330032 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330035 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330038 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330041 2586 flags.go:64] FLAG: --eviction-soft="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330044 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330046 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330049 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330054 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330057 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330060 2586 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 13:24:38.402599 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330062 2586 flags.go:64] FLAG: --feature-gates="" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330066 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330069 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330072 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330076 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330079 2586 flags.go:64] FLAG: --healthz-port="10248" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330082 2586 flags.go:64] FLAG: --help="false" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330085 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-128-102.ec2.internal" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330088 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330091 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330094 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330097 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330102 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330105 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330108 2586 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330111 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330114 2586 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330118 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330122 2586 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330125 2586 flags.go:64] FLAG: --kube-reserved="" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330127 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330130 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330133 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330136 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 13:24:38.506083 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330139 2586 flags.go:64] FLAG: --lock-file="" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330142 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330145 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330147 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330153 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330157 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330160 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330163 2586 flags.go:64] FLAG: --logging-format="text" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330165 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330169 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330171 2586 flags.go:64] FLAG: --manifest-url="" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330174 2586 flags.go:64] FLAG: --manifest-url-header="" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330179 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330182 2586 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330186 2586 flags.go:64] FLAG: --max-pods="110" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330189 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330192 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330194 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330197 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330200 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330207 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330210 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330217 2586 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330220 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330222 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 13:24:38.507318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330226 2586 flags.go:64] FLAG: --pod-cidr="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330229 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330235 2586 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330238 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330241 2586 flags.go:64] FLAG: --pods-per-core="0" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330244 2586 flags.go:64] FLAG: --port="10250" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330247 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330250 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047b26298c05d5319" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330253 2586 flags.go:64] FLAG: --qos-reserved="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330256 2586 flags.go:64] FLAG: --read-only-port="10255" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330259 2586 flags.go:64] FLAG: --register-node="true" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330262 2586 flags.go:64] FLAG: --register-with-taints="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330265 2586 flags.go:64] FLAG: --registry-burst="10" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330270 2586 flags.go:64] FLAG: --registry-qps="5" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330272 2586 flags.go:64] FLAG: --reserved-cpus="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330275 2586 flags.go:64] FLAG: --reserved-memory="" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330279 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330282 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330286 2586 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330289 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330291 2586 flags.go:64] FLAG: --runonce="false" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330294 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330297 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330300 2586 flags.go:64] FLAG: --seccomp-default="false" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330303 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 13:24:38.512133 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330306 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330309 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330313 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330316 2586 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330319 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330322 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330325 2586 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330328 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330331 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330334 2586 flags.go:64] FLAG: --system-cgroups="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330337 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330342 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330345 2586 flags.go:64] FLAG: --tls-cert-file="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330348 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330352 2586 flags.go:64] FLAG: --tls-min-version="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330355 2586 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330358 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330361 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330363 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330366 2586 flags.go:64] FLAG: --v="2" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330372 2586 flags.go:64] FLAG: --version="false" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330376 2586 flags.go:64] FLAG: --vmodule="" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330380 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330383 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330499 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.513034 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330503 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330506 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330509 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330531 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330535 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330538 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330541 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330544 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330547 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330551 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330554 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330556 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330559 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330562 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330565 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330568 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330571 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330574 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330577 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.516520 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330580 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330582 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330585 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330588 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330592 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330596 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330598 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330601 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330605 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330608 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330616 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330628 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330631 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330634 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330638 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330640 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330644 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330646 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330649 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.517336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330652 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330654 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330657 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330661 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330664 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330666 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330669 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330671 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330674 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330677 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330679 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330682 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330685 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330688 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330691 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330693 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330696 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330698 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330701 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330703 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.520801 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330706 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330710 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330713 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330716 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330718 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330721 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330724 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330726 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330729 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330731 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330734 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330737 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330739 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330742 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330745 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330749 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330753 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330756 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330759 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.521656 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330762 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330765 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330768 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330771 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330774 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330776 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330780 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330782 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330785 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330787 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330790 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330792 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330795 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330797 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330801 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330804 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330807 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330809 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330812 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330815 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.526418 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.330818 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.330823 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.337678 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.337694 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.337713 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.337719 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337777 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337784 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337788 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337791 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337794 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337797 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337800 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337802 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.527280 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337805 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337808 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337811 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337814 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337817 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337820 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337823 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337825 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337828 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337832 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337835 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337839 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337842 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337845 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337847 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337850 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337852 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337855 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337857 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.532497 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337861 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337863 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337867 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337869 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337872 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337876 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337878 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337881 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337883 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337886 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337889 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337891 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337894 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337896 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337899 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337901 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337904 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337907 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337912 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337915 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.533367 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337918 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337920 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337923 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337925 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337928 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337931 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337934 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337936 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337939 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337941 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337944 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337946 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337950 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337953 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337955 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337958 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337960 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337963 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337966 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337969 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.534214 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337971 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337974 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337977 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337979 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337982 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337984 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337987 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337989 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337992 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337994 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.337997 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338000 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338003 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338005 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338008 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338010 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338013 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338015 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338018 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338020 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.538964 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338023 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338025 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338043 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338047 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338053 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338056 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338059 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338062 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338065 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338068 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338071 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338073 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.338079 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338195 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338200 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 13:24:38.539831 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338203 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338206 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338209 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338212 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338214 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338217 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338220 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338223 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338226 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338229 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338232 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338234 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338237 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338240 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338242 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338244 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338247 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338249 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338252 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338254 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 13:24:38.540693 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338257 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338261 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338265 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338268 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338270 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338273 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338275 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338278 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338281 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338283 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338286 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338288 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338291 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338294 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338296 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338299 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338301 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338304 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338306 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338309 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 13:24:38.646487 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338311 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338314 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338317 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338320 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338322 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338325 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338329 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338333 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338335 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338338 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338340 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338343 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338345 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338350 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338354 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338356 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338359 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338361 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338364 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 13:24:38.647333 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338366 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338369 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338372 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338374 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338377 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338379 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338382 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338384 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338387 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338389 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338392 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338394 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338397 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338400 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338402 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338406 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338410 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338413 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338416 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338418 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 13:24:38.650760 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338421 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338424 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338428 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338430 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338433 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338436 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338440 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338444 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338447 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338449 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338452 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338455 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338457 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338460 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338463 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338466 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338468 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 13:24:38.651628 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:38.338471 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.338476 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.338605 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.340760 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.342098 2586 server.go:1019] "Starting client certificate rotation" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.342221 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.342802 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.344983 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.349010 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.356340 2586 log.go:25] "Validated CRI v1 runtime API" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.358431 2586 log.go:25] "Validated CRI v1 image API" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.361304 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 13:24:38.656393 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.364339 2586 fs.go:135] Filesystem UUIDs: map[26abd35b-b7ed-42b1-a938-638b4df0c986:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ede0c1f2-3671-4901-bcd3-b52a6356b485:/dev/nvme0n1p3] Jul 09 13:24:38.656843 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.364362 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.369324 2586 manager.go:216] Machine: {Timestamp:2026-07-09 13:24:38.368131573 +0000 UTC m=+0.337745528 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099756 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2923391db1f594891c2b493749b897 SystemUUID:ec292339-1db1-f594-891c-2b493749b897 BootID:39d937e8-3260-44c2-95e1-2b825b891283 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:20:8b:05:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:20:8b:05:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:74:0f:dd:e5:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.369437 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.369587 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.373210 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.373253 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.375328 2586 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.375348 2586 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 13:24:38.769000 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.375360 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.376133 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.377457 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.380608 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.380778 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.381491 2586 kubelet.go:486] "Attempting to sync node with API server" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.381527 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.381556 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.381572 2586 kubelet.go:398] "Adding apiserver pod source" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.381588 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.382052 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.382075 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.384247 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.386133 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.386161 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387751 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387764 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387771 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387776 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387785 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387790 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387798 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387803 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387810 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387815 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387823 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.387828 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.388875 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.388882 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.392069 2586 server.go:1268] "Started kubelet" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.392146 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.392230 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.392856 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.393468 2586 server.go:310] "Adding debug handlers to kubelet server" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.396549 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.400442 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.403076 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.403082 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.403170 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.403888 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.403758 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.403926 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404051 2586 reconstruct.go:97] "Volume reconstruction finished" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404062 2586 reconciler.go:29] "Reconciler: start to sync state" Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404270 2586 factory.go:55] Registering systemd factory Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404285 2586 factory.go:223] Registration of the systemd container factory successfully Jul 09 13:24:38.769794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404502 2586 factory.go:153] Registering CRI-O factory Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404510 2586 factory.go:223] Registration of the crio container factory successfully Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404573 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404594 2586 factory.go:103] Registering Raw factory Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.404610 2586 manager.go:1196] Started watching for new ooms in manager Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.405046 2586 manager.go:349] Starting recovery of all containers Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.414651 2586 manager.go:354] Recovery completed Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.418857 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.503715 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.604142 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.771470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.704655 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.805108 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.805083 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.873347 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873319 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:38.873458 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873359 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:38.873458 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873375 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:38.873924 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873909 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 13:24:38.873924 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873921 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 13:24:38.874048 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873926 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:38.874048 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.873943 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 09 13:24:38.874666 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.874643 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:38.874792 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.874675 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:38.874792 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.874688 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:38.875411 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.875398 2586 policy_none.go:49] "None policy: Start" Jul 09 13:24:38.875455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.875416 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 13:24:38.875455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.875428 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 13:24:38.876497 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.876484 2586 policy_none.go:47] "Start" Jul 09 13:24:38.881480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.881457 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:24:38.883417 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.883343 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 13:24:38.884073 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.883354 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 13:24:38.884073 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.883515 2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 13:24:38.884073 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.883894 2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 13:24:38.884073 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.883981 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 13:24:38.885202 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.884086 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1e9e5b554c6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.392034502 +0000 UTC m=+0.361648458,LastTimestamp:2026-07-09 13:24:38.392034502 +0000 UTC m=+0.361648458,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.888290 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.888218 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea026580bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.87334214 +0000 UTC m=+0.842956097,LastTimestamp:2026-07-09 13:24:38.87334214 +0000 UTC m=+0.842956097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.900279 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.900056 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea0265e23f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.873367103 +0000 UTC m=+0.842981062,LastTimestamp:2026-07-09 13:24:38.873367103 +0000 UTC m=+0.842981062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.904376 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.904360 2586 manager.go:337] "Starting Device Plugin manager" Jul 09 13:24:38.904447 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.904399 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 13:24:38.904447 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.904410 2586 server.go:87] "Starting device plugin registration server" Jul 09 13:24:38.904835 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.904821 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 13:24:38.904920 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.904837 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 13:24:38.904981 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.904964 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 13:24:38.905042 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.905030 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 13:24:38.905042 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.905043 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 13:24:38.905632 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.905602 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 13:24:38.905727 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.905670 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:38.911688 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.911610 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea02661505 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.873380101 +0000 UTC m=+0.842994058,LastTimestamp:2026-07-09 13:24:38.873380101 +0000 UTC m=+0.842994058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.925166 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.925071 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-102.ec2.internal.18c0a1ea026580bc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea026580bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.87334214 +0000 UTC m=+0.842956097,LastTimestamp:2026-07-09 13:24:38.874658406 +0000 UTC m=+0.844272367,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.939277 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.939181 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-102.ec2.internal.18c0a1ea0265e23f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea0265e23f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.873367103 +0000 UTC m=+0.842981062,LastTimestamp:2026-07-09 13:24:38.874681792 +0000 UTC m=+0.844295756,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.943659 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.943623 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n88j" Jul 09 13:24:38.950688 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:38.950599 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-102.ec2.internal.18c0a1ea02661505\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-102.ec2.internal.18c0a1ea02661505 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-102.ec2.internal,UID:ip-10-0-128-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-102.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-102.ec2.internal,},FirstTimestamp:2026-07-09 13:24:38.873380101 +0000 UTC m=+0.842994058,LastTimestamp:2026-07-09 13:24:38.874692433 +0000 UTC m=+0.844306391,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-102.ec2.internal,}" Jul 09 13:24:38.959302 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:38.952273 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6n88j" Jul 09 13:24:39.005838 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.005798 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:39.006943 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.006922 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:39.007046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.006954 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:39.007046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.006965 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:39.007046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.006990 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.017202 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.017183 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.017275 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.017210 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-102.ec2.internal\": node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.047516 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.047440 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.053362 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.053318 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 13:24:39.054738 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.054720 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 13:24:39.054817 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.054763 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 13:24:39.054817 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.054794 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 13:24:39.054890 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.054840 2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 13:24:39.057318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.057296 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:39.150500 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.150468 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.154948 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.154903 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal"] Jul 09 13:24:39.155046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.155014 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:39.157975 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.157955 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:39.158079 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.157993 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:39.158079 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.158007 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:39.159413 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.159396 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:39.159543 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.159513 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.159629 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.159560 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:39.160299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160279 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:39.160400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160282 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:39.160400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160315 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:39.160400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160331 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:39.160400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160335 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:39.160400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.160350 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:39.161681 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.161666 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.161732 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.161694 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:39.162496 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.162481 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:39.162566 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.162508 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:39.162566 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.162519 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:39.187633 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.187581 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-102.ec2.internal\" not found" node="ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.192458 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.192437 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-102.ec2.internal\" not found" node="ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.208669 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.208638 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/440edf1b6fe2a0ad7fefd4e133e5dff2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-102.ec2.internal\" (UID: \"440edf1b6fe2a0ad7fefd4e133e5dff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.208770 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.208671 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.208770 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.208696 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.250945 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.250900 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.309218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309135 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.309218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309160 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.309218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309190 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.309218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309217 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/440edf1b6fe2a0ad7fefd4e133e5dff2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-102.ec2.internal\" (UID: \"440edf1b6fe2a0ad7fefd4e133e5dff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.309441 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309267 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/440edf1b6fe2a0ad7fefd4e133e5dff2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-102.ec2.internal\" (UID: \"440edf1b6fe2a0ad7fefd4e133e5dff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.309441 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.309291 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b12742c50da2a025857008b028eb6256-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal\" (UID: \"b12742c50da2a025857008b028eb6256\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.342049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.342011 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 13:24:39.342232 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.342213 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 13:24:39.352089 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.352060 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.453773 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.453737 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.491809 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.491764 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.496431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.496397 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:39.554775 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.554738 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.658662 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.658568 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.730476 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.730444 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:39.760084 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.760051 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.860910 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.860866 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:39.957694 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.957579 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:19:39 +0000 UTC" deadline="2028-03-01 22:43:27.436955386 +0000 UTC" Jul 09 13:24:39.957694 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:39.957636 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14433h18m47.479322853s" Jul 09 13:24:39.962034 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:39.962013 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:40.014110 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.014066 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 13:24:40.015261 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.015231 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientMemory" Jul 09 13:24:40.015401 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.015268 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 13:24:40.015401 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.015284 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeHasSufficientPID" Jul 09 13:24:40.062387 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.062356 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:40.163558 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.163491 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-102.ec2.internal\" not found" Jul 09 13:24:40.195721 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.195695 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:40.204278 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.204249 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" Jul 09 13:24:40.213330 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.213260 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:24:40.214951 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.214920 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" Jul 09 13:24:40.228414 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.228391 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 13:24:40.289787 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.289753 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440edf1b6fe2a0ad7fefd4e133e5dff2.slice/crio-ba2565414aaed8425e8de9325e18ffbeb0a04539eb958155d7e79fa162ce280b WatchSource:0}: Error finding container ba2565414aaed8425e8de9325e18ffbeb0a04539eb958155d7e79fa162ce280b: Status 404 returned error can't find the container with id ba2565414aaed8425e8de9325e18ffbeb0a04539eb958155d7e79fa162ce280b Jul 09 13:24:40.290039 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.290023 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12742c50da2a025857008b028eb6256.slice/crio-41f959428116a8698fa162254a6134726eeb16cdd4147a71964cbe2ffa99469b WatchSource:0}: Error finding container 41f959428116a8698fa162254a6134726eeb16cdd4147a71964cbe2ffa99469b: Status 404 returned error can't find the container with id 41f959428116a8698fa162254a6134726eeb16cdd4147a71964cbe2ffa99469b Jul 09 13:24:40.295289 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.295268 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:24:40.382456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.382418 2586 apiserver.go:52] "Watching apiserver" Jul 09 13:24:40.393726 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.393692 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 13:24:40.394111 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.394088 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-j4dsn","openshift-network-diagnostics/network-check-target-zzj74","openshift-network-operator/iptables-alerter-kbbcv","openshift-ovn-kubernetes/ovnkube-node-tv6sv","kube-system/global-pull-secret-syncer-c2dlc","kube-system/konnectivity-agent-p22nv","kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal","openshift-dns/node-resolver-pd5zg","openshift-image-registry/node-ca-c5jhw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-n6g86","openshift-multus/network-metrics-daemon-p974t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt","openshift-cluster-node-tuning-operator/tuned-4ghfn"] Jul 09 13:24:40.396524 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.396506 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.397873 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.397853 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.399051 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399036 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.399483 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399465 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.399572 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399555 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 13:24:40.399658 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399573 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v7x28\"" Jul 09 13:24:40.399658 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399576 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.399658 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.399606 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 13:24:40.400163 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.400147 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.400292 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.400275 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.400530 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.400512 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vsnxs\"" Jul 09 13:24:40.400992 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.400971 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.401569 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.401548 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 13:24:40.401569 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.401571 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.401737 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.401644 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gwxtt\"" Jul 09 13:24:40.401915 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.401899 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.402386 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.402363 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.402478 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.402445 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:40.403240 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403224 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 13:24:40.403334 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403305 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.403492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403474 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 13:24:40.403681 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403666 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qg9j\"" Jul 09 13:24:40.403759 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403751 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.404078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403873 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.404078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.403970 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 13:24:40.404188 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.404155 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 13:24:40.404314 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.404295 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 13:24:40.405278 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.405261 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.406098 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.406080 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 13:24:40.406326 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.406308 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 13:24:40.406392 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.406343 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sz75c\"" Jul 09 13:24:40.407504 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.407491 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.407504 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.407498 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hsr7d\"" Jul 09 13:24:40.407814 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.407798 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.408114 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.407954 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.409396 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.409379 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.410246 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.410227 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.410344 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.410324 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.410469 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.410454 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vg4k\"" Jul 09 13:24:40.410716 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.410699 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 13:24:40.410797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.410709 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.410863 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.410846 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:40.411677 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.411661 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 13:24:40.411727 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.411706 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7bfw\"" Jul 09 13:24:40.411986 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.411968 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 13:24:40.412304 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.412136 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.413432 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.413411 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:40.413526 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.413477 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:40.415167 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.415148 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 13:24:40.415167 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.415155 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 13:24:40.415328 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.415231 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 13:24:40.415328 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.415244 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 13:24:40.415447 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.415155 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-df8g5\"" Jul 09 13:24:40.416177 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416135 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskb7\" (UniqueName: \"kubernetes.io/projected/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-kube-api-access-mskb7\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.416270 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416180 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-modprobe-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.416327 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416269 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-tmp\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.416384 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416331 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-netd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.416384 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416369 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.416481 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416395 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416538 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-var-lib-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416614 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12fe538c-430e-4766-80ef-578febbb0ed9-ovn-node-metrics-cert\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416649 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80fce52-1f97-47bb-ad03-17299f6e8470-agent-certs\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416686 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8ww\" (UniqueName: \"kubernetes.io/projected/3866394e-5e8b-40e0-b87e-691975db2ee1-kube-api-access-hn8ww\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416721 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/954e2534-9399-4832-bb82-b0b9fb3d01cd-kube-api-access-xc54g\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416755 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-k8s-cni-cncf-io\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416789 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-multus-certs\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416819 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7fb7d115-43b1-40a8-928f-a1986fe07e87-iptables-alerter-script\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416849 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-var-lib-kubelet\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416882 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb7d115-43b1-40a8-928f-a1986fe07e87-host-slash\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416912 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7lb\" (UniqueName: \"kubernetes.io/projected/7fb7d115-43b1-40a8-928f-a1986fe07e87-kube-api-access-rk7lb\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.416983 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-sys\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417012 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-host\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417037 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-ovn\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417065 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-node-log\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417096 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cnibin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417127 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-multus\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417152 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-conf-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417184 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-kubernetes\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417217 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-kubelet\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417248 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-conf\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417282 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417312 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417344 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417379 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-os-release\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417409 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-bin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417438 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d186a121-6c73-4135-8378-d23d74ce3278-hosts-file\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.419826 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417471 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrv7\" (UniqueName: \"kubernetes.io/projected/d186a121-6c73-4135-8378-d23d74ce3278-kube-api-access-4zrv7\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417496 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-systemd\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417525 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-tuned\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417555 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-etc-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417586 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cni-binary-copy\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417641 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417674 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlx5\" (UniqueName: \"kubernetes.io/projected/12fe538c-430e-4766-80ef-578febbb0ed9-kube-api-access-hrlx5\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417724 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d186a121-6c73-4135-8378-d23d74ce3278-tmp-dir\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417765 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysconfig\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417893 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-slash\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.417999 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-socket-dir-parent\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418041 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-kubelet\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418094 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-daemon-config\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418133 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-system-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418160 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-systemd-units\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418229 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-log-socket\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418292 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-env-overrides\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418334 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-netns\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418367 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-hostroot\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418422 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-config\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418460 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-run\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.418490 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-netns\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419233 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-bin\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419303 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80fce52-1f97-47bb-ad03-17299f6e8470-konnectivity-ca\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419387 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-etc-kubernetes\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419447 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-lib-modules\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419535 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-systemd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.420735 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.419579 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-script-lib\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.446731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.446706 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:40.450372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.450355 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 13:24:40.485022 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.484932 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr8nt" Jul 09 13:24:40.493672 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.493645 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tr8nt" Jul 09 13:24:40.505586 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.505552 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 13:24:40.520171 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520129 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskb7\" (UniqueName: \"kubernetes.io/projected/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-kube-api-access-mskb7\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520170 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-modprobe-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520197 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-tmp\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520219 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-netd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520244 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520274 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec92cb-878b-4c35-9988-d41e120b1009-serviceca\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520298 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520326 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-var-lib-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520352 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12fe538c-430e-4766-80ef-578febbb0ed9-ovn-node-metrics-cert\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520357 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-netd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520377 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80fce52-1f97-47bb-ad03-17299f6e8470-agent-certs\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520359 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520418 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8ww\" (UniqueName: \"kubernetes.io/projected/3866394e-5e8b-40e0-b87e-691975db2ee1-kube-api-access-hn8ww\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520434 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-modprobe-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.520613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520463 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/954e2534-9399-4832-bb82-b0b9fb3d01cd-kube-api-access-xc54g\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520470 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-var-lib-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520499 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-d\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520506 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-k8s-cni-cncf-io\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520533 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-multus-certs\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520690 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-k8s-cni-cncf-io\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520674 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520724 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7fb7d115-43b1-40a8-928f-a1986fe07e87-iptables-alerter-script\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520757 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-multus-certs\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520841 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-var-lib-kubelet\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520913 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec92cb-878b-4c35-9988-d41e120b1009-host\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.520974 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb7d115-43b1-40a8-928f-a1986fe07e87-host-slash\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521046 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7lb\" (UniqueName: \"kubernetes.io/projected/7fb7d115-43b1-40a8-928f-a1986fe07e87-kube-api-access-rk7lb\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521054 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-var-lib-kubelet\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521171 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-sys\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.521369 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521183 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb7d115-43b1-40a8-928f-a1986fe07e87-host-slash\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521230 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-host\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521253 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-ovn\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521274 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-node-log\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521297 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-sys\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521309 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfxx\" (UniqueName: \"kubernetes.io/projected/5dec92cb-878b-4c35-9988-d41e120b1009-kube-api-access-rmfxx\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521333 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-dbus\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521338 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-host\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521359 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-ovn\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521396 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cnibin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521433 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-multus\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521443 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7fb7d115-43b1-40a8-928f-a1986fe07e87-iptables-alerter-script\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521468 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-conf-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521472 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-node-log\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521476 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cnibin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521508 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-multus\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521513 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-kubernetes\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521549 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-conf-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521590 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-kubelet\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521597 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-kubernetes\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521618 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-os-release\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521646 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521651 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-kubelet\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521669 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-conf\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521694 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn282\" (UniqueName: \"kubernetes.io/projected/439b54f7-0b20-463f-8e8c-65e219fb7071-kube-api-access-mn282\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521742 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521767 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521788 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521802 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysctl-conf\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.522963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521815 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-kubelet-config\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521843 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.521879 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521895 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-os-release\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521929 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-bin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521950 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521860 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.521973 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:24:41.02193718 +0000 UTC m=+2.991551128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.521970 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-cni-bin\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522013 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-os-release\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522032 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d186a121-6c73-4135-8378-d23d74ce3278-hosts-file\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522080 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrv7\" (UniqueName: \"kubernetes.io/projected/d186a121-6c73-4135-8378-d23d74ce3278-kube-api-access-4zrv7\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522107 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-systemd\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522151 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d186a121-6c73-4135-8378-d23d74ce3278-hosts-file\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522201 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-systemd\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.523695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-tuned\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522285 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-etc-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522310 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cni-binary-copy\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522334 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522363 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-etc-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522376 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlx5\" (UniqueName: \"kubernetes.io/projected/12fe538c-430e-4766-80ef-578febbb0ed9-kube-api-access-hrlx5\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522405 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cnibin\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522431 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522459 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522485 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522512 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522559 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d186a121-6c73-4135-8378-d23d74ce3278-tmp-dir\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522586 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysconfig\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522610 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-slash\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.524394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522626 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-openvswitch\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522636 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522663 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-socket-dir-parent\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522689 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-kubelet\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522720 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-daemon-config\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522746 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522772 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-socket-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522800 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522828 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-system-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522856 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-systemd-units\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522885 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-log-socket\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522912 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-env-overrides\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522938 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-netns\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522964 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-hostroot\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522988 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-config\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523018 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf8cz\" (UniqueName: \"kubernetes.io/projected/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-kube-api-access-lf8cz\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523044 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-device-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523087 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d186a121-6c73-4135-8378-d23d74ce3278-tmp-dir\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523102 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-run\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523092 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-socket-dir-parent\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523153 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-netns\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523196 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-bin\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523202 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-run-netns\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523224 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80fce52-1f97-47bb-ad03-17299f6e8470-konnectivity-ca\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523242 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-hostroot\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-etc-kubernetes\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523279 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-lib-modules\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523306 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-systemd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523320 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-multus-daemon-config\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523331 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-script-lib\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523359 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-registration-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523385 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-sys-fs\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523045 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-slash\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.522988 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-cni-binary-copy\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523447 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-sysconfig\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523387 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-host-var-lib-kubelet\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523510 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-cni-bin\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523542 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-host-run-netns\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523541 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-env-overrides\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523539 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-systemd-units\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523611 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-system-cni-dir\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523661 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-log-socket\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523697 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-etc-kubernetes\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523743 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-run\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.525955 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523786 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3866394e-5e8b-40e0-b87e-691975db2ee1-lib-modules\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.523850 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12fe538c-430e-4766-80ef-578febbb0ed9-run-systemd\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.524446 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-config\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.524679 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12fe538c-430e-4766-80ef-578febbb0ed9-ovnkube-script-lib\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.524854 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-tmp\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.524870 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c80fce52-1f97-47bb-ad03-17299f6e8470-konnectivity-ca\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.524978 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12fe538c-430e-4766-80ef-578febbb0ed9-ovn-node-metrics-cert\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.525050 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c80fce52-1f97-47bb-ad03-17299f6e8470-agent-certs\") pod \"konnectivity-agent-p22nv\" (UID: \"c80fce52-1f97-47bb-ad03-17299f6e8470\") " pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.526431 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.526150 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3866394e-5e8b-40e0-b87e-691975db2ee1-etc-tuned\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.529789 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.529744 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8ww\" (UniqueName: \"kubernetes.io/projected/3866394e-5e8b-40e0-b87e-691975db2ee1-kube-api-access-hn8ww\") pod \"tuned-4ghfn\" (UID: \"3866394e-5e8b-40e0-b87e-691975db2ee1\") " pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.529975 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.529951 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskb7\" (UniqueName: \"kubernetes.io/projected/6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01-kube-api-access-mskb7\") pod \"multus-j4dsn\" (UID: \"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01\") " pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.530058 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.529963 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc54g\" (UniqueName: \"kubernetes.io/projected/954e2534-9399-4832-bb82-b0b9fb3d01cd-kube-api-access-xc54g\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:40.530482 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.530458 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7lb\" (UniqueName: \"kubernetes.io/projected/7fb7d115-43b1-40a8-928f-a1986fe07e87-kube-api-access-rk7lb\") pod \"iptables-alerter-kbbcv\" (UID: \"7fb7d115-43b1-40a8-928f-a1986fe07e87\") " pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.531392 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.531374 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrv7\" (UniqueName: \"kubernetes.io/projected/d186a121-6c73-4135-8378-d23d74ce3278-kube-api-access-4zrv7\") pod \"node-resolver-pd5zg\" (UID: \"d186a121-6c73-4135-8378-d23d74ce3278\") " pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.531859 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.531844 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlx5\" (UniqueName: \"kubernetes.io/projected/12fe538c-430e-4766-80ef-578febbb0ed9-kube-api-access-hrlx5\") pod \"ovnkube-node-tv6sv\" (UID: \"12fe538c-430e-4766-80ef-578febbb0ed9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.624328 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624288 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-kubelet-config\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.624328 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624324 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624350 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cnibin\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624375 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624400 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624421 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-system-cni-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624425 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cnibin\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624421 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-kubelet-config\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624429 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624516 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624490 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624543 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.624627 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624654 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-etc-selinux\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624662 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.624683 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:24:41.124663967 +0000 UTC m=+3.094277917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624706 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624719 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-socket-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624751 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624786 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf8cz\" (UniqueName: \"kubernetes.io/projected/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-kube-api-access-lf8cz\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624813 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-device-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.624875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.624823 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-socket-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625000 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-device-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625012 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-registration-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625058 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-sys-fs\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625080 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625052 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625091 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec92cb-878b-4c35-9988-d41e120b1009-serviceca\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625081 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-registration-dir\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625103 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625129 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/439b54f7-0b20-463f-8e8c-65e219fb7071-sys-fs\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625180 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec92cb-878b-4c35-9988-d41e120b1009-host\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625210 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfxx\" (UniqueName: \"kubernetes.io/projected/5dec92cb-878b-4c35-9988-d41e120b1009-kube-api-access-rmfxx\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625225 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-dbus\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625246 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-os-release\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625367 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625262 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625279 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn282\" (UniqueName: \"kubernetes.io/projected/439b54f7-0b20-463f-8e8c-65e219fb7071-kube-api-access-mn282\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625324 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79725ec9-6a1a-4e7f-8af6-e440a26629ce-dbus\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625353 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-os-release\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625353 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5dec92cb-878b-4c35-9988-d41e120b1009-host\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625437 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.625848 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.625467 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5dec92cb-878b-4c35-9988-d41e120b1009-serviceca\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.635007 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.634982 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:40.635007 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.635010 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:40.635225 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.635024 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:40.635225 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:40.635136 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:41.135122541 +0000 UTC m=+3.104736484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:40.636740 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.636714 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfxx\" (UniqueName: \"kubernetes.io/projected/5dec92cb-878b-4c35-9988-d41e120b1009-kube-api-access-rmfxx\") pod \"node-ca-c5jhw\" (UID: \"5dec92cb-878b-4c35-9988-d41e120b1009\") " pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.636863 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.636747 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf8cz\" (UniqueName: \"kubernetes.io/projected/6b8cfa43-67bd-4931-86db-3c20ceea2c4d-kube-api-access-lf8cz\") pod \"multus-additional-cni-plugins-n6g86\" (UID: \"6b8cfa43-67bd-4931-86db-3c20ceea2c4d\") " pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.637327 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.637311 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn282\" (UniqueName: \"kubernetes.io/projected/439b54f7-0b20-463f-8e8c-65e219fb7071-kube-api-access-mn282\") pod \"aws-ebs-csi-driver-node-v9zgt\" (UID: \"439b54f7-0b20-463f-8e8c-65e219fb7071\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.708592 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.708547 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j4dsn" Jul 09 13:24:40.716927 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.716895 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" Jul 09 13:24:40.717967 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.717942 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2c9b6b_1f75_4449_ab38_2b6c92b4ba01.slice/crio-64dc71f35a64fdcc7a970a25c66a13b207ebcf5300d34bf77f338e5f9fa7ad57 WatchSource:0}: Error finding container 64dc71f35a64fdcc7a970a25c66a13b207ebcf5300d34bf77f338e5f9fa7ad57: Status 404 returned error can't find the container with id 64dc71f35a64fdcc7a970a25c66a13b207ebcf5300d34bf77f338e5f9fa7ad57 Jul 09 13:24:40.724451 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.724431 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbbcv" Jul 09 13:24:40.724806 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.724783 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3866394e_5e8b_40e0_b87e_691975db2ee1.slice/crio-559376ff0fb2950bd1995e01fdf18ff1f905377b859c4b89eb4649593880aaeb WatchSource:0}: Error finding container 559376ff0fb2950bd1995e01fdf18ff1f905377b859c4b89eb4649593880aaeb: Status 404 returned error can't find the container with id 559376ff0fb2950bd1995e01fdf18ff1f905377b859c4b89eb4649593880aaeb Jul 09 13:24:40.730570 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.730549 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:24:40.732028 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.732005 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb7d115_43b1_40a8_928f_a1986fe07e87.slice/crio-f85eeb74ce9db07feb7a86845814dc6751f39b790d3bad91658060185e4964cb WatchSource:0}: Error finding container f85eeb74ce9db07feb7a86845814dc6751f39b790d3bad91658060185e4964cb: Status 404 returned error can't find the container with id f85eeb74ce9db07feb7a86845814dc6751f39b790d3bad91658060185e4964cb Jul 09 13:24:40.734950 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.734922 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:40.740807 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.740783 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd5zg" Jul 09 13:24:40.741007 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.740988 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fe538c_430e_4766_80ef_578febbb0ed9.slice/crio-7b71a0d7dc9cb5d95f7f333b4ec2034d2678ea0445b89739ea6b1746a7dc6c88 WatchSource:0}: Error finding container 7b71a0d7dc9cb5d95f7f333b4ec2034d2678ea0445b89739ea6b1746a7dc6c88: Status 404 returned error can't find the container with id 7b71a0d7dc9cb5d95f7f333b4ec2034d2678ea0445b89739ea6b1746a7dc6c88 Jul 09 13:24:40.743485 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.743459 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80fce52_1f97_47bb_ad03_17299f6e8470.slice/crio-f12cd67ff7747c9f5a7fdf60099c27926aefe96b3507b193460c07bb8ae906f5 WatchSource:0}: Error finding container f12cd67ff7747c9f5a7fdf60099c27926aefe96b3507b193460c07bb8ae906f5: Status 404 returned error can't find the container with id f12cd67ff7747c9f5a7fdf60099c27926aefe96b3507b193460c07bb8ae906f5 Jul 09 13:24:40.747908 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.747885 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c5jhw" Jul 09 13:24:40.748940 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.748917 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd186a121_6c73_4135_8378_d23d74ce3278.slice/crio-1e5cfd129a059399186d49da169a9a505737d049d9fd49aee0d295fb94ecb73e WatchSource:0}: Error finding container 1e5cfd129a059399186d49da169a9a505737d049d9fd49aee0d295fb94ecb73e: Status 404 returned error can't find the container with id 1e5cfd129a059399186d49da169a9a505737d049d9fd49aee0d295fb94ecb73e Jul 09 13:24:40.754351 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.754324 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6g86" Jul 09 13:24:40.757203 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.757176 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dec92cb_878b_4c35_9988_d41e120b1009.slice/crio-84cc6dff56bfa6adf0f0f5afb7de89f7796eb7d5c32f642cdf97738d0aa0a9a2 WatchSource:0}: Error finding container 84cc6dff56bfa6adf0f0f5afb7de89f7796eb7d5c32f642cdf97738d0aa0a9a2: Status 404 returned error can't find the container with id 84cc6dff56bfa6adf0f0f5afb7de89f7796eb7d5c32f642cdf97738d0aa0a9a2 Jul 09 13:24:40.758465 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:40.758446 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" Jul 09 13:24:40.762625 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.762590 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b8cfa43_67bd_4931_86db_3c20ceea2c4d.slice/crio-9f107a0c14066e3945d12392f85aa33478a259e0354d3d0e6b3cbd630f407d03 WatchSource:0}: Error finding container 9f107a0c14066e3945d12392f85aa33478a259e0354d3d0e6b3cbd630f407d03: Status 404 returned error can't find the container with id 9f107a0c14066e3945d12392f85aa33478a259e0354d3d0e6b3cbd630f407d03 Jul 09 13:24:40.767358 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:24:40.767335 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439b54f7_0b20_463f_8e8c_65e219fb7071.slice/crio-e2cc38504ccc200d8ea86418e8a47478153960d3e166e235fab9c6364a4d1b21 WatchSource:0}: Error finding container e2cc38504ccc200d8ea86418e8a47478153960d3e166e235fab9c6364a4d1b21: Status 404 returned error can't find the container with id e2cc38504ccc200d8ea86418e8a47478153960d3e166e235fab9c6364a4d1b21 Jul 09 13:24:41.029268 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.029162 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:41.029408 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.029314 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:41.029408 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.029381 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:24:42.029366146 +0000 UTC m=+3.998980090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:41.060005 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.059942 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" event={"ID":"b12742c50da2a025857008b028eb6256","Type":"ContainerStarted","Data":"41f959428116a8698fa162254a6134726eeb16cdd4147a71964cbe2ffa99469b"} Jul 09 13:24:41.062355 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.062319 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" event={"ID":"3866394e-5e8b-40e0-b87e-691975db2ee1","Type":"ContainerStarted","Data":"559376ff0fb2950bd1995e01fdf18ff1f905377b859c4b89eb4649593880aaeb"} Jul 09 13:24:41.063766 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.063731 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4dsn" event={"ID":"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01","Type":"ContainerStarted","Data":"64dc71f35a64fdcc7a970a25c66a13b207ebcf5300d34bf77f338e5f9fa7ad57"} Jul 09 13:24:41.065028 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.064988 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" event={"ID":"440edf1b6fe2a0ad7fefd4e133e5dff2","Type":"ContainerStarted","Data":"ba2565414aaed8425e8de9325e18ffbeb0a04539eb958155d7e79fa162ce280b"} Jul 09 13:24:41.066200 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.066172 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" event={"ID":"439b54f7-0b20-463f-8e8c-65e219fb7071","Type":"ContainerStarted","Data":"e2cc38504ccc200d8ea86418e8a47478153960d3e166e235fab9c6364a4d1b21"} Jul 09 13:24:41.067312 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.067285 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerStarted","Data":"9f107a0c14066e3945d12392f85aa33478a259e0354d3d0e6b3cbd630f407d03"} Jul 09 13:24:41.068744 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.068721 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5jhw" event={"ID":"5dec92cb-878b-4c35-9988-d41e120b1009","Type":"ContainerStarted","Data":"84cc6dff56bfa6adf0f0f5afb7de89f7796eb7d5c32f642cdf97738d0aa0a9a2"} Jul 09 13:24:41.070085 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.070061 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd5zg" event={"ID":"d186a121-6c73-4135-8378-d23d74ce3278","Type":"ContainerStarted","Data":"1e5cfd129a059399186d49da169a9a505737d049d9fd49aee0d295fb94ecb73e"} Jul 09 13:24:41.071231 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.071205 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p22nv" event={"ID":"c80fce52-1f97-47bb-ad03-17299f6e8470","Type":"ContainerStarted","Data":"f12cd67ff7747c9f5a7fdf60099c27926aefe96b3507b193460c07bb8ae906f5"} Jul 09 13:24:41.072670 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.072638 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"7b71a0d7dc9cb5d95f7f333b4ec2034d2678ea0445b89739ea6b1746a7dc6c88"} Jul 09 13:24:41.073964 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.073899 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbbcv" event={"ID":"7fb7d115-43b1-40a8-928f-a1986fe07e87","Type":"ContainerStarted","Data":"f85eeb74ce9db07feb7a86845814dc6751f39b790d3bad91658060185e4964cb"} Jul 09 13:24:41.129962 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.129913 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:41.130138 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.130096 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:41.130215 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.130162 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:24:42.130147682 +0000 UTC m=+4.099761630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:41.231381 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.231346 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:41.231563 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.231537 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:41.231612 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.231570 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:41.231612 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.231580 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:41.231685 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:41.231641 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:42.231625555 +0000 UTC m=+4.201239499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:41.495793 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.495625 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:19:41 +0000 UTC" deadline="2028-02-04 15:44:28.616782537 +0000 UTC" Jul 09 13:24:41.495793 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:41.495662 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13802h19m47.121125053s" Jul 09 13:24:42.040401 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.040359 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:42.040624 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.040599 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:42.040700 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.040686 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:24:44.040661685 +0000 UTC m=+6.010275634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:42.056353 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.055843 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:42.056353 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.056012 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:42.061664 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.058527 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:42.061664 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.058739 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:42.061664 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.058857 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:42.061664 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.059090 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:42.141310 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.141114 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:42.141517 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.141329 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:42.141517 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.141393 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:24:44.141373929 +0000 UTC m=+6.110987889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:42.242299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.242191 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:42.242470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.242367 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:42.242470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.242386 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:42.242470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.242400 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:42.242470 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:42.242470 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:44.242448408 +0000 UTC m=+6.212062370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:42.497192 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.497070 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:19:41 +0000 UTC" deadline="2028-02-16 21:43:45.226466863 +0000 UTC" Jul 09 13:24:42.497192 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:42.497129 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14096h19m2.729341735s" Jul 09 13:24:44.055619 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.055486 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:44.056132 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.055648 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:44.056132 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.055741 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:44.056132 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.055834 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:44.056132 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.055895 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:44.056132 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.055971 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:44.057798 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.057708 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:44.057939 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.057876 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:44.057939 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.057935 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:24:48.057915462 +0000 UTC m=+10.027529426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:44.159171 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.158974 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:44.159171 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.159159 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:44.159434 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.159239 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:24:48.159218039 +0000 UTC m=+10.128832000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:44.259619 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:44.259575 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:44.259820 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.259772 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:44.259820 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.259802 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:44.259820 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.259816 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:44.259989 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:44.259881 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:48.259861749 +0000 UTC m=+10.229475708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:46.055319 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:46.055281 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:46.055903 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:46.055295 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:46.055903 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:46.055438 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:46.055903 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:46.055295 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:46.055903 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:46.055552 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:46.055903 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:46.055651 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:48.055455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.055396 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:48.055991 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.055541 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:48.055991 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.055562 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:48.055991 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.055583 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:48.055991 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.055691 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:48.055991 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.055780 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:48.094975 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.094932 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:48.095168 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.095105 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:48.095222 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.095187 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:24:56.095164464 +0000 UTC m=+18.064778412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:48.195650 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.195606 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:48.195844 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.195815 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:48.195936 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.195903 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:24:56.195882151 +0000 UTC m=+18.165496101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:48.296781 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:48.296739 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:48.296985 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.296925 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:48.296985 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.296948 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:48.296985 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.296960 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:48.297174 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:48.297023 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:24:56.297003634 +0000 UTC m=+18.266617593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:50.055420 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:50.055384 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:50.055864 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:50.055397 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:50.055864 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:50.055541 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:50.055864 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:50.055403 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:50.055864 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:50.055594 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:50.055864 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:50.055715 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:52.055380 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:52.055335 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:52.055380 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:52.055357 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:52.055914 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:52.055357 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:52.055914 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:52.055471 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:52.055914 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:52.055625 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:52.055914 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:52.055697 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:54.055728 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.055450 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:54.056161 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.055485 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:54.056161 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.055486 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:54.056161 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:54.055846 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:54.056161 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:54.055925 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:54.056161 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:54.055999 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:54.131316 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.130866 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" event={"ID":"3866394e-5e8b-40e0-b87e-691975db2ee1","Type":"ContainerStarted","Data":"dbb782b774e95b23b72897c383688f3d16a72622f8067cd0c37122dd94be858f"} Jul 09 13:24:54.132597 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.132566 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" event={"ID":"440edf1b6fe2a0ad7fefd4e133e5dff2","Type":"ContainerStarted","Data":"18797ac3cfdee9ff6a17e91a822208da1111da98ef10f6e5a4de333731b5f3bc"} Jul 09 13:24:54.148975 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.148917 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4ghfn" podStartSLOduration=2.3917211099999998 podStartE2EDuration="15.14889822s" totalImagesPullingTime="12.75717711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:54.148033743 +0000 UTC m=+16.117647707" watchObservedRunningTime="2026-07-09 13:24:54.14889822 +0000 UTC m=+16.118512186" Jul 09 13:24:54.162198 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:54.162157 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-102.ec2.internal" podStartSLOduration=14.162142228 podStartE2EDuration="14.162142228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:54.161987879 +0000 UTC m=+16.131601842" watchObservedRunningTime="2026-07-09 13:24:54.162142228 +0000 UTC m=+16.131756192" Jul 09 13:24:55.136700 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.136654 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerStarted","Data":"45dd2e68dba9fa1fc243b4dc2dd9b3f95c7237e06091a063daf8f69fa22b5e78"} Jul 09 13:24:55.138572 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.138543 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c5jhw" event={"ID":"5dec92cb-878b-4c35-9988-d41e120b1009","Type":"ContainerStarted","Data":"75143f0f48081f90746f23000ab75df6bc66f869e2c0673acac49de97797aec8"} Jul 09 13:24:55.140324 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.140291 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd5zg" event={"ID":"d186a121-6c73-4135-8378-d23d74ce3278","Type":"ContainerStarted","Data":"1e7140fa1bafc14bf62fd96e4f71fd767e916e18b0640254ff833c85df1e388f"} Jul 09 13:24:55.142221 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.142192 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p22nv" event={"ID":"c80fce52-1f97-47bb-ad03-17299f6e8470","Type":"ContainerStarted","Data":"7350fa6a10b467939d11dc44757fd32397f63e5aa3208810b127ceb17f548b7a"} Jul 09 13:24:55.144062 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.144039 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbbcv" event={"ID":"7fb7d115-43b1-40a8-928f-a1986fe07e87","Type":"ContainerStarted","Data":"3288ae2663c5d4b1774397c1b696de04edcbcbdca1da3445d89fe5468f5b8365"} Jul 09 13:24:55.145779 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.145735 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" event={"ID":"b12742c50da2a025857008b028eb6256","Type":"ContainerStarted","Data":"4eb922e88a4b00e9acf79d68bfc2cbf653960394bf251e554d6d21997854a038"} Jul 09 13:24:55.147507 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.147470 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" event={"ID":"439b54f7-0b20-463f-8e8c-65e219fb7071","Type":"ContainerStarted","Data":"0247952b9d439ba276a7dc255284a8981b4bc4d34771f838dae1e71a57c2184f"} Jul 09 13:24:55.180446 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.180378 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p22nv" podStartSLOduration=2.524980792 podStartE2EDuration="15.180356416s" totalImagesPullingTime="12.655375624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:55.179858504 +0000 UTC m=+17.149472469" watchObservedRunningTime="2026-07-09 13:24:55.180356416 +0000 UTC m=+17.149970394" Jul 09 13:24:55.235318 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.235272 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kbbcv" podStartSLOduration=3.523454947 podStartE2EDuration="16.23525713s" totalImagesPullingTime="12.711802183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:55.216265864 +0000 UTC m=+17.185879828" watchObservedRunningTime="2026-07-09 13:24:55.23525713 +0000 UTC m=+17.204871093" Jul 09 13:24:55.235615 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.235585 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pd5zg" podStartSLOduration=2.502471163 podStartE2EDuration="15.235577841s" totalImagesPullingTime="12.733106678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:55.235087928 +0000 UTC m=+17.204701891" watchObservedRunningTime="2026-07-09 13:24:55.235577841 +0000 UTC m=+17.205191805" Jul 09 13:24:55.269342 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:55.269290 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c5jhw" podStartSLOduration=2.604166298 podStartE2EDuration="15.26927469s" totalImagesPullingTime="12.665108392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:24:55.268826465 +0000 UTC m=+17.238440431" watchObservedRunningTime="2026-07-09 13:24:55.26927469 +0000 UTC m=+17.238888660" Jul 09 13:24:56.055581 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.055375 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:56.055804 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.055390 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:56.055804 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.055689 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:56.055804 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.055403 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:56.055804 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.055730 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:56.055981 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.055847 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:56.161448 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.161420 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:56.161903 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.161585 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:56.161903 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.161648 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:25:12.161630405 +0000 UTC m=+34.131244348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:24:56.262383 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.262277 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:56.263004 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.262652 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:56.263004 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.262713 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:25:12.262694324 +0000 UTC m=+34.232308283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:24:56.363564 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:56.363470 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:56.363822 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.363653 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:24:56.363822 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.363676 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:24:56.363822 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.363689 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:56.363822 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:56.363748 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:12.36373033 +0000 UTC m=+34.333344290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:24:57.329636 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:57.329559 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:57.330409 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:57.330389 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:58.055120 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.055029 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:24:58.055120 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.055051 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:24:58.055363 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.055156 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:24:58.055363 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:58.055169 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:24:58.055363 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:58.055250 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:24:58.055493 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:24:58.055350 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:24:58.154362 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.154323 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="45dd2e68dba9fa1fc243b4dc2dd9b3f95c7237e06091a063daf8f69fa22b5e78" exitCode=0 Jul 09 13:24:58.154547 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.154402 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"45dd2e68dba9fa1fc243b4dc2dd9b3f95c7237e06091a063daf8f69fa22b5e78"} Jul 09 13:24:58.154659 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.154645 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:24:58.155247 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:24:58.155227 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p22nv" Jul 09 13:25:00.055487 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:00.055444 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:00.056191 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:00.055444 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:00.056191 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:00.055596 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:00.056191 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:00.055444 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:00.056191 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:00.055657 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:00.056191 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:00.055718 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:02.055494 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.055464 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:02.055494 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.055487 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:02.056031 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.055507 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:02.056031 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:02.055599 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:02.056031 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:02.055698 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:02.056031 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:02.055776 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:02.169682 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.169470 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"073030db017174b6ea431cf93e088a59d3fe36d2d0b63d6b37129e808e78a808"} Jul 09 13:25:02.171947 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.171920 2586 generic.go:356] "Generic (PLEG): container finished" podID="b12742c50da2a025857008b028eb6256" containerID="4eb922e88a4b00e9acf79d68bfc2cbf653960394bf251e554d6d21997854a038" exitCode=0 Jul 09 13:25:02.172051 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.171988 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" event={"ID":"b12742c50da2a025857008b028eb6256","Type":"ContainerDied","Data":"4eb922e88a4b00e9acf79d68bfc2cbf653960394bf251e554d6d21997854a038"} Jul 09 13:25:02.174731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.174662 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j4dsn" event={"ID":"6d2c9b6b-1f75-4449-ab38-2b6c92b4ba01","Type":"ContainerStarted","Data":"3f8596f94bf8af75576c337fb93845a9ee49a269995a1b643888d3b11d1475c2"} Jul 09 13:25:02.208475 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.208420 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j4dsn" podStartSLOduration=1.885851466 podStartE2EDuration="23.20839804s" totalImagesPullingTime="21.322546574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:02.208359974 +0000 UTC m=+24.177973939" watchObservedRunningTime="2026-07-09 13:25:02.20839804 +0000 UTC m=+24.178012004" Jul 09 13:25:02.240270 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.240242 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 13:25:02.919574 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.919305 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T13:25:02.240266242Z","UUID":"4a6bda7d-c38d-456a-932f-7879db53440d","Handler":null,"Name":"","Endpoint":""} Jul 09 13:25:02.922032 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.922007 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 13:25:02.922168 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:02.922048 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 13:25:03.178895 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.178809 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" event={"ID":"439b54f7-0b20-463f-8e8c-65e219fb7071","Type":"ContainerStarted","Data":"f1d5940cfc483c506b1516a8e7a7b4ac690b4b700338fec7c390ac22a08039a9"} Jul 09 13:25:03.181634 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.181608 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"84e029c7926c311978ee1b798403ac14ed5a3fffd3d1fcab3410c9cced19fada"} Jul 09 13:25:03.181768 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.181689 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"6b50dd79e2237c8ef385ae8db2538555ba84f66811148d5533d379d1b675784d"} Jul 09 13:25:03.181768 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.181742 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"decf16f12397707d439d4c633da0bf56cc50d2a9ca032a91e2ebd8bb9087ecc0"} Jul 09 13:25:03.181875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.181788 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"d395ff87e2f02313c75e2a3dd626e82a9d6933a8da0fba15640aca447dadc42c"} Jul 09 13:25:03.181875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.181828 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"2d938087823021765f1d27a55b9508253d2e22b61700cb465cc416da1ae1c335"} Jul 09 13:25:03.183448 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.183425 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" event={"ID":"b12742c50da2a025857008b028eb6256","Type":"ContainerStarted","Data":"51e2d3c8c604f9819d4a44be279f54bd93101187b7e5896c7eae5f9dd6fff111"} Jul 09 13:25:03.203353 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:03.203304 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-102.ec2.internal" podStartSLOduration=23.203290202 podStartE2EDuration="23.203290202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:03.203272496 +0000 UTC m=+25.172886462" watchObservedRunningTime="2026-07-09 13:25:03.203290202 +0000 UTC m=+25.172904166" Jul 09 13:25:04.055090 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:04.055053 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:04.055090 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:04.055086 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:04.055365 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:04.055086 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:04.055365 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:04.055194 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:04.055365 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:04.055308 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:04.055507 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:04.055378 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:05.189473 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:05.189437 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" event={"ID":"439b54f7-0b20-463f-8e8c-65e219fb7071","Type":"ContainerStarted","Data":"7bc9c99a008f729db111044ca09f9e467f73ee9cd5fd68e849e1a036ad2b066f"} Jul 09 13:25:05.192632 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:05.192606 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"89dcdf443bfcc2b062d01c05c7c138e08e9256d095af86b5fa5946886aa2fa8e"} Jul 09 13:25:06.055485 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:06.055450 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:06.055707 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:06.055574 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:06.055707 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:06.055588 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:06.055707 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:06.055610 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:06.055707 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:06.055694 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:06.055868 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:06.055757 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:07.201648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.201358 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" event={"ID":"12fe538c-430e-4766-80ef-578febbb0ed9","Type":"ContainerStarted","Data":"783f190978d0f5acfc310f156943b7a74911ebfed7ba6fe5b1bd1653b8b6fa65"} Jul 09 13:25:07.202484 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.201663 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:07.202484 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.201719 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:07.219152 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.219126 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:07.229907 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.229848 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" podStartSLOduration=6.930650442 podStartE2EDuration="28.229833197s" totalImagesPullingTime="21.299182755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:07.229730258 +0000 UTC m=+29.199344237" watchObservedRunningTime="2026-07-09 13:25:07.229833197 +0000 UTC m=+29.199447162" Jul 09 13:25:07.230400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:07.230361 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v9zgt" podStartSLOduration=5.312358568 podStartE2EDuration="27.230350784s" totalImagesPullingTime="21.917992216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:05.213276944 +0000 UTC m=+27.182890908" watchObservedRunningTime="2026-07-09 13:25:07.230350784 +0000 UTC m=+29.199964799" Jul 09 13:25:08.055218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.055187 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:08.055448 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.055188 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:08.055448 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.055312 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:08.055448 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.055297 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:08.055448 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.055385 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:08.055642 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.055474 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:08.204858 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.204826 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:08.220858 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.220830 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:08.865905 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.865871 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2dlc"] Jul 09 13:25:08.866089 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.865994 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:08.866089 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.866079 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:08.868372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.868349 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzj74"] Jul 09 13:25:08.868494 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.868428 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:08.868568 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.868504 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:08.871560 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.871537 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p974t"] Jul 09 13:25:08.871659 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:08.871639 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:08.871776 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:08.871753 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:09.208793 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:09.208763 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="66b03616bf06cc6d302e01a043c748fef5ddd01681df9746a0d3a91c63097fb3" exitCode=0 Jul 09 13:25:09.209169 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:09.208841 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"66b03616bf06cc6d302e01a043c748fef5ddd01681df9746a0d3a91c63097fb3"} Jul 09 13:25:10.055736 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:10.055707 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:10.055911 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:10.055818 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:11.055569 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:11.055531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:11.055963 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:11.055644 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:11.055963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:11.055706 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:11.055963 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:11.055824 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:11.215606 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:11.215565 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="c6afd04ec6fd270acc7d502ebf9a7a729794d4208a63c8cbb2762daf0cf13d0b" exitCode=0 Jul 09 13:25:11.215770 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:11.215626 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"c6afd04ec6fd270acc7d502ebf9a7a729794d4208a63c8cbb2762daf0cf13d0b"} Jul 09 13:25:12.055625 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.055446 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:12.055942 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.055716 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:12.174470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.174433 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:12.174648 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.174593 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:12.174691 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.174662 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:25:44.174647022 +0000 UTC m=+66.144260964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 13:25:12.220031 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.220000 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="1c22cf47caeeb5730cffb0b4f45ac3a113d4a64a1a2ba05aec31124e9352fd28" exitCode=0 Jul 09 13:25:12.220199 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.220060 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"1c22cf47caeeb5730cffb0b4f45ac3a113d4a64a1a2ba05aec31124e9352fd28"} Jul 09 13:25:12.275452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.275358 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:12.275620 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.275503 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:12.275620 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.275591 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret podName:79725ec9-6a1a-4e7f-8af6-e440a26629ce nodeName:}" failed. No retries permitted until 2026-07-09 13:25:44.275570769 +0000 UTC m=+66.245184711 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret") pod "global-pull-secret-syncer-c2dlc" (UID: "79725ec9-6a1a-4e7f-8af6-e440a26629ce") : object "kube-system"/"original-pull-secret" not registered Jul 09 13:25:12.376439 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:12.376398 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:12.376662 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.376557 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 13:25:12.376662 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.376580 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 13:25:12.376662 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.376595 2586 projected.go:196] Error preparing data for projected volume kube-api-access-kt279 for pod openshift-network-diagnostics/network-check-target-zzj74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:12.376662 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:12.376663 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279 podName:db5923df-bf11-40df-975c-201cd269f083 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:44.37664339 +0000 UTC m=+66.346257357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kt279" (UniqueName: "kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279") pod "network-check-target-zzj74" (UID: "db5923df-bf11-40df-975c-201cd269f083") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 13:25:13.055966 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:13.055933 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:13.056334 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:13.056038 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:13.056334 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:13.056099 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:13.056334 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:13.056212 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:14.055469 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:14.055430 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:14.055665 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:14.055569 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p974t" podUID="954e2534-9399-4832-bb82-b0b9fb3d01cd" Jul 09 13:25:15.056079 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.056043 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:15.056592 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:15.056150 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2dlc" podUID="79725ec9-6a1a-4e7f-8af6-e440a26629ce" Jul 09 13:25:15.056592 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.056181 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:15.056592 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:15.056227 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzj74" podUID="db5923df-bf11-40df-975c-201cd269f083" Jul 09 13:25:15.856722 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.856654 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-102.ec2.internal" event="NodeReady" Jul 09 13:25:15.856865 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.856802 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 13:25:15.892053 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.892024 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:25:15.907254 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.907229 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:25:15.907420 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.907324 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:15.909017 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.908992 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mmmc7"] Jul 09 13:25:15.909905 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.909868 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vrwn\"" Jul 09 13:25:15.910022 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.909910 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 13:25:15.910074 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.910046 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 13:25:15.910074 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.910059 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 13:25:15.917503 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.917478 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 13:25:15.920396 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.920377 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7b9nn"] Jul 09 13:25:15.920529 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.920498 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:15.923626 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.923603 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 13:25:15.923730 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.923648 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8c6wn\"" Jul 09 13:25:15.923884 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.923871 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 13:25:15.936425 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.936398 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7b9nn"] Jul 09 13:25:15.936425 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.936426 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmmc7"] Jul 09 13:25:15.936565 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.936500 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:15.939076 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.939058 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 13:25:15.939278 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.939264 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdp26\"" Jul 09 13:25:15.939507 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.939489 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 13:25:15.939631 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.939597 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 13:25:15.999857 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.999820 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:15.999857 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.999869 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.000106 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.999895 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flqgz\" (UniqueName: \"kubernetes.io/projected/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-kube-api-access-flqgz\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.000106 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:15.999967 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000106 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000067 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000106 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000097 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000121 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-config-volume\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000153 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000181 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000201 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000266 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwzk\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.000308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.000282 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-tmp-dir\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.055085 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.055042 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:16.057961 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.057932 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:25:16.057961 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.057952 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gn99p\"" Jul 09 13:25:16.101110 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101074 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101110 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101111 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101130 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101161 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwzk\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101177 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-tmp-dir\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.101218 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.101234 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:16.101325 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.101321 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:16.601302917 +0000 UTC m=+38.570916873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101342 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323f4821-77e5-4922-802c-aa2e5375a978-cert\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101378 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101418 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101442 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flqgz\" (UniqueName: \"kubernetes.io/projected/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-kube-api-access-flqgz\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101470 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8qv2\" (UniqueName: \"kubernetes.io/projected/323f4821-77e5-4922-802c-aa2e5375a978-kube-api-access-w8qv2\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101498 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101554 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.101567 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101587 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101588 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-tmp-dir\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101616 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-config-volume\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.101641 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.101633 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:16.60161484 +0000 UTC m=+38.571228799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:16.102122 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101909 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.102122 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.101993 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.102232 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.102213 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-config-volume\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.102444 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.102419 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.105342 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.105322 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.105342 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.105334 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.110110 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.110029 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flqgz\" (UniqueName: \"kubernetes.io/projected/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-kube-api-access-flqgz\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.110402 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.110384 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwzk\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.110474 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.110435 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.202875 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.202838 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323f4821-77e5-4922-802c-aa2e5375a978-cert\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.203039 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.202904 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8qv2\" (UniqueName: \"kubernetes.io/projected/323f4821-77e5-4922-802c-aa2e5375a978-kube-api-access-w8qv2\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.205694 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.205666 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/323f4821-77e5-4922-802c-aa2e5375a978-cert\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.210974 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.210943 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8qv2\" (UniqueName: \"kubernetes.io/projected/323f4821-77e5-4922-802c-aa2e5375a978-kube-api-access-w8qv2\") pod \"ingress-canary-7b9nn\" (UID: \"323f4821-77e5-4922-802c-aa2e5375a978\") " pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.244317 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.244280 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7b9nn" Jul 09 13:25:16.471754 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.471705 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7b9nn"] Jul 09 13:25:16.477170 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:16.477134 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323f4821_77e5_4922_802c_aa2e5375a978.slice/crio-c1483a325537cb769d78ed277da3b81a37288f85af735f889f7b577331e373ff WatchSource:0}: Error finding container c1483a325537cb769d78ed277da3b81a37288f85af735f889f7b577331e373ff: Status 404 returned error can't find the container with id c1483a325537cb769d78ed277da3b81a37288f85af735f889f7b577331e373ff Jul 09 13:25:16.605964 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.605731 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.605899 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:16.606006 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.606057 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:17.606040386 +0000 UTC m=+39.575654327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.606112 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.606127 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:16.606188 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:16.606178 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:17.606163028 +0000 UTC m=+39.575776989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:17.059090 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.059061 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:17.059743 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.059238 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:17.062001 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.061977 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:25:17.062880 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.062859 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rpg8s\"" Jul 09 13:25:17.062982 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.062866 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:25:17.062982 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.062902 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:25:17.233791 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.233756 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7b9nn" event={"ID":"323f4821-77e5-4922-802c-aa2e5375a978","Type":"ContainerStarted","Data":"c1483a325537cb769d78ed277da3b81a37288f85af735f889f7b577331e373ff"} Jul 09 13:25:17.612948 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.612911 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:17.613117 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:17.612982 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:17.613159 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:17.613118 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:17.613159 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:17.613136 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:17.613247 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:17.613189 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:19.613169409 +0000 UTC m=+41.582783366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:17.613247 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:17.613117 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:17.613339 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:17.613272 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:19.613255337 +0000 UTC m=+41.582869281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:19.630803 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:19.630764 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:19.630827 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:19.630931 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:19.630990 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:23.630976285 +0000 UTC m=+45.600590230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:19.630935 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:19.631013 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:19.631158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:19.631048 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:23.631039666 +0000 UTC m=+45.600653621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:20.243067 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:20.243036 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7b9nn" event={"ID":"323f4821-77e5-4922-802c-aa2e5375a978","Type":"ContainerStarted","Data":"59210ae02be762337b4085de26ccdfdaa34295d7e11f66dd41804ee11ff3432c"} Jul 09 13:25:20.246084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:20.246060 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="f49cc57d163c701718a0f99543ba6347c8f91432e585f06fb56020a520e1bffb" exitCode=0 Jul 09 13:25:20.246198 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:20.246095 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"f49cc57d163c701718a0f99543ba6347c8f91432e585f06fb56020a520e1bffb"} Jul 09 13:25:20.262033 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:20.261970 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7b9nn" podStartSLOduration=1.7816958920000001 podStartE2EDuration="5.261953811s" totalImagesPullingTime="3.480257919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:20.261572203 +0000 UTC m=+42.231186167" watchObservedRunningTime="2026-07-09 13:25:20.261953811 +0000 UTC m=+42.231567776" Jul 09 13:25:21.250975 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:21.250789 2586 generic.go:356] "Generic (PLEG): container finished" podID="6b8cfa43-67bd-4931-86db-3c20ceea2c4d" containerID="cb0875a480aae874246a050d163d6ad39ce61e93f24cdd194df841de148269f5" exitCode=0 Jul 09 13:25:21.251385 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:21.250858 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerDied","Data":"cb0875a480aae874246a050d163d6ad39ce61e93f24cdd194df841de148269f5"} Jul 09 13:25:22.255851 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:22.255818 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6g86" event={"ID":"6b8cfa43-67bd-4931-86db-3c20ceea2c4d","Type":"ContainerStarted","Data":"43cccb3d63d455434319f702ede40e642fbf6ca88540c6fc39ead108a72b391d"} Jul 09 13:25:22.279895 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:22.279847 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6g86" podStartSLOduration=9.393324637 podStartE2EDuration="42.279828367s" totalImagesPullingTime="32.88650373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:22.278489534 +0000 UTC m=+44.248103498" watchObservedRunningTime="2026-07-09 13:25:22.279828367 +0000 UTC m=+44.249442333" Jul 09 13:25:23.662043 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:23.661999 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:23.662076 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:23.662172 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:23.662186 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:23.662195 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:23.662254 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:31.66223784 +0000 UTC m=+53.631851783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:23.662415 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:23.662267 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:31.662261154 +0000 UTC m=+53.631875096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:31.069566 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.069504 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242"] Jul 09 13:25:31.092470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.092435 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4"] Jul 09 13:25:31.092663 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.092581 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.095319 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.095289 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 13:25:31.095319 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.095310 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 13:25:31.095556 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.095309 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 13:25:31.096743 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.096720 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8m2n9\"" Jul 09 13:25:31.096857 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.096844 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 13:25:31.116538 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.116493 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242"] Jul 09 13:25:31.116678 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.116553 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4"] Jul 09 13:25:31.116678 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.116644 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.117681 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.117659 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5f91285-8777-4422-81d1-20d5ddf8496b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.117797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.117713 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.117797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.117786 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgfc\" (UniqueName: \"kubernetes.io/projected/c5f91285-8777-4422-81d1-20d5ddf8496b-kube-api-access-rbgfc\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.119346 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.119320 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 13:25:31.119346 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.119343 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 13:25:31.119539 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.119362 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tm8kv\"" Jul 09 13:25:31.119539 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.119387 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:25:31.184076 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.184048 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z"] Jul 09 13:25:31.196714 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.196687 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.198767 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.198745 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z"] Jul 09 13:25:31.199264 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.199244 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 13:25:31.199494 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.199469 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gv65j\"" Jul 09 13:25:31.199494 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.199490 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:25:31.199691 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.199603 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 13:25:31.199769 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.199755 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 13:25:31.218702 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218668 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8958s\" (UniqueName: \"kubernetes.io/projected/798c3854-3b2a-40a0-ba75-1cc1704981ff-kube-api-access-8958s\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.218844 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218754 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5f91285-8777-4422-81d1-20d5ddf8496b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.218844 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218800 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/798c3854-3b2a-40a0-ba75-1cc1704981ff-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.218844 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218820 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798c3854-3b2a-40a0-ba75-1cc1704981ff-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.218942 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218848 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.218975 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.218945 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:31.219015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.218975 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpkxq\" (UniqueName: \"kubernetes.io/projected/239a4cc2-b61b-47d6-9f26-9044e4b38804-kube-api-access-wpkxq\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.219015 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.219010 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:25:31.718992244 +0000 UTC m=+53.688606208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:31.219109 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.219039 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgfc\" (UniqueName: \"kubernetes.io/projected/c5f91285-8777-4422-81d1-20d5ddf8496b-kube-api-access-rbgfc\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.219109 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.219056 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.219457 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.219436 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5f91285-8777-4422-81d1-20d5ddf8496b-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.238945 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.238916 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgfc\" (UniqueName: \"kubernetes.io/projected/c5f91285-8777-4422-81d1-20d5ddf8496b-kube-api-access-rbgfc\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.319898 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.319806 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8958s\" (UniqueName: \"kubernetes.io/projected/798c3854-3b2a-40a0-ba75-1cc1704981ff-kube-api-access-8958s\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.319898 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.319873 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/798c3854-3b2a-40a0-ba75-1cc1704981ff-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.319898 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.319891 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798c3854-3b2a-40a0-ba75-1cc1704981ff-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.320137 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.319936 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpkxq\" (UniqueName: \"kubernetes.io/projected/239a4cc2-b61b-47d6-9f26-9044e4b38804-kube-api-access-wpkxq\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.320137 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.319966 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.320137 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.320060 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:25:31.320137 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.320132 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls podName:239a4cc2-b61b-47d6-9f26-9044e4b38804 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:31.820113084 +0000 UTC m=+53.789727040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sjb4" (UID: "239a4cc2-b61b-47d6-9f26-9044e4b38804") : secret "samples-operator-tls" not found Jul 09 13:25:31.320539 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.320492 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/798c3854-3b2a-40a0-ba75-1cc1704981ff-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.322238 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.322217 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/798c3854-3b2a-40a0-ba75-1cc1704981ff-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.328010 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.327986 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8958s\" (UniqueName: \"kubernetes.io/projected/798c3854-3b2a-40a0-ba75-1cc1704981ff-kube-api-access-8958s\") pod \"kube-storage-version-migrator-operator-846bf668f7-nhg9z\" (UID: \"798c3854-3b2a-40a0-ba75-1cc1704981ff\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.328198 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.328181 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpkxq\" (UniqueName: \"kubernetes.io/projected/239a4cc2-b61b-47d6-9f26-9044e4b38804-kube-api-access-wpkxq\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.506088 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.506051 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" Jul 09 13:25:31.661192 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.661158 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z"] Jul 09 13:25:31.664666 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:31.664643 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798c3854_3b2a_40a0_ba75_1cc1704981ff.slice/crio-8c64c8696e97f823e8ba65bca337262fed95ad6fce00434dd4820e1a06884dbb WatchSource:0}: Error finding container 8c64c8696e97f823e8ba65bca337262fed95ad6fce00434dd4820e1a06884dbb: Status 404 returned error can't find the container with id 8c64c8696e97f823e8ba65bca337262fed95ad6fce00434dd4820e1a06884dbb Jul 09 13:25:31.723195 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.723151 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.723220 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.723277 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723302 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723357 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723364 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 13:25:31.723390 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723380 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bd45f9d48-cmsrt: secret "image-registry-tls" not found Jul 09 13:25:31.723638 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723396 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls podName:90c8ad8c-83ae-42e2-825d-3212d1aea1cf nodeName:}" failed. No retries permitted until 2026-07-09 13:25:47.723380164 +0000 UTC m=+69.692994106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls") pod "dns-default-mmmc7" (UID: "90c8ad8c-83ae-42e2-825d-3212d1aea1cf") : secret "dns-default-metrics-tls" not found Jul 09 13:25:31.723638 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723411 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:25:32.723405075 +0000 UTC m=+54.693019017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:31.723638 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.723422 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls podName:7b156b07-b28e-4ce8-b5ae-3122654c17e7 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:47.723416985 +0000 UTC m=+69.693030928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls") pod "image-registry-6bd45f9d48-cmsrt" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7") : secret "image-registry-tls" not found Jul 09 13:25:31.823620 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:31.823574 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:31.823808 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.823727 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:25:31.823808 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:31.823791 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls podName:239a4cc2-b61b-47d6-9f26-9044e4b38804 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:32.823775189 +0000 UTC m=+54.793389130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sjb4" (UID: "239a4cc2-b61b-47d6-9f26-9044e4b38804") : secret "samples-operator-tls" not found Jul 09 13:25:32.279255 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:32.279217 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" event={"ID":"798c3854-3b2a-40a0-ba75-1cc1704981ff","Type":"ContainerStarted","Data":"8c64c8696e97f823e8ba65bca337262fed95ad6fce00434dd4820e1a06884dbb"} Jul 09 13:25:32.731997 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:32.731962 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:32.732187 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:32.732121 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:32.732231 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:32.732198 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:25:34.732182273 +0000 UTC m=+56.701796216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:32.833289 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:32.833247 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:32.833471 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:32.833412 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:25:32.833611 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:32.833596 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls podName:239a4cc2-b61b-47d6-9f26-9044e4b38804 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:34.83357199 +0000 UTC m=+56.803185951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sjb4" (UID: "239a4cc2-b61b-47d6-9f26-9044e4b38804") : secret "samples-operator-tls" not found Jul 09 13:25:34.285259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:34.285221 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" event={"ID":"798c3854-3b2a-40a0-ba75-1cc1704981ff","Type":"ContainerStarted","Data":"cb6e9e96f4329ab338af539b9ee72164768d99d980c7df6d49db9e64a66f45fb"} Jul 09 13:25:34.302094 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:34.302031 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" podStartSLOduration=1.058643461 podStartE2EDuration="3.302009875s" totalImagesPullingTime="2.243366414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:34.301330652 +0000 UTC m=+56.270944615" watchObservedRunningTime="2026-07-09 13:25:34.302009875 +0000 UTC m=+56.271623841" Jul 09 13:25:34.751782 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:34.751744 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:34.751964 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:34.751916 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:34.752010 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:34.751999 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.75197912 +0000 UTC m=+60.721593066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:34.852734 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:34.852690 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:34.852927 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:34.852856 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:25:34.852927 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:34.852925 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls podName:239a4cc2-b61b-47d6-9f26-9044e4b38804 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.852909588 +0000 UTC m=+60.822523530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sjb4" (UID: "239a4cc2-b61b-47d6-9f26-9044e4b38804") : secret "samples-operator-tls" not found Jul 09 13:25:37.466600 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.466570 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ljfwb"] Jul 09 13:25:37.468548 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.468512 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.471031 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.471005 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 13:25:37.471295 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.471274 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 13:25:37.471582 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.471561 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 13:25:37.471844 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.471276 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 13:25:37.472197 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.472180 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fzhd8\"" Jul 09 13:25:37.482752 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.482728 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ljfwb"] Jul 09 13:25:37.573682 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.573646 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2tg\" (UniqueName: \"kubernetes.io/projected/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-api-access-hn2tg\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.573842 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.573687 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a521e97-25a4-4bf6-82d9-e86912946ed5-crio-socket\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.573842 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.573784 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.573842 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.573835 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.573944 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.573858 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a521e97-25a4-4bf6-82d9-e86912946ed5-data-volume\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675104 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675066 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2tg\" (UniqueName: \"kubernetes.io/projected/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-api-access-hn2tg\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675208 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675110 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a521e97-25a4-4bf6-82d9-e86912946ed5-crio-socket\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675208 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675177 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675277 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675230 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675277 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675255 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a521e97-25a4-4bf6-82d9-e86912946ed5-data-volume\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675362 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675283 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a521e97-25a4-4bf6-82d9-e86912946ed5-crio-socket\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.675414 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:37.675367 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:37.675414 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:37.675374 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:37.675487 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:37.675425 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.175406496 +0000 UTC m=+60.145020456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:37.675487 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:37.675440 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:38.175433666 +0000 UTC m=+60.145047607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : configmap "kube-rbac-proxy" not found Jul 09 13:25:37.675626 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.675605 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a521e97-25a4-4bf6-82d9-e86912946ed5-data-volume\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:37.683774 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:37.683751 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2tg\" (UniqueName: \"kubernetes.io/projected/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-api-access-hn2tg\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:38.178877 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:38.178829 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:38.178877 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:38.178888 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:38.179093 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.178980 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:38.179093 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.178997 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:38.179093 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.179047 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:39.179031767 +0000 UTC m=+61.148645709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:38.179093 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.179064 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:39.179056847 +0000 UTC m=+61.148670789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : configmap "kube-rbac-proxy" not found Jul 09 13:25:38.784049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:38.784013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:38.784454 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.784140 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:38.784454 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.784194 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:25:46.784180255 +0000 UTC m=+68.753794197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:38.884972 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:38.884939 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:38.885148 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.885089 2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 13:25:38.885190 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:38.885156 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls podName:239a4cc2-b61b-47d6-9f26-9044e4b38804 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:46.885140321 +0000 UTC m=+68.854754263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sjb4" (UID: "239a4cc2-b61b-47d6-9f26-9044e4b38804") : secret "samples-operator-tls" not found Jul 09 13:25:39.187250 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:39.187211 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:39.187394 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:39.187270 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:39.187394 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:39.187335 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:39.187394 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:39.187384 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:41.187371131 +0000 UTC m=+63.156985072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : configmap "kube-rbac-proxy" not found Jul 09 13:25:39.187542 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:39.187439 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:39.187542 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:39.187465 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:41.187458359 +0000 UTC m=+63.157072300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:40.221970 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:40.221939 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tv6sv" Jul 09 13:25:40.464015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:40.463985 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd5zg_d186a121-6c73-4135-8378-d23d74ce3278/dns-node-resolver/0.log" Jul 09 13:25:41.206834 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:41.206796 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:41.207010 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:41.206902 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:41.207010 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:41.206921 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:41.207010 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:41.206987 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:45.206969876 +0000 UTC m=+67.176583818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : configmap "kube-rbac-proxy" not found Jul 09 13:25:41.207010 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:41.206998 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:41.207158 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:41.207039 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:45.207028316 +0000 UTC m=+67.176642257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:41.463972 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:41.463899 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5jhw_5dec92cb-878b-4c35-9988-d41e120b1009/node-ca/0.log" Jul 09 13:25:41.864858 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:41.864773 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7b9nn_323f4821-77e5-4922-802c-aa2e5375a978/serve-healthcheck-canary/0.log" Jul 09 13:25:42.863483 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:42.863448 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-nhg9z_798c3854-3b2a-40a0-ba75-1cc1704981ff/kube-storage-version-migrator-operator/0.log" Jul 09 13:25:44.229741 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.229703 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:25:44.232235 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.232214 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 13:25:44.240781 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:44.240759 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 13:25:44.240898 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:44.240836 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs podName:954e2534-9399-4832-bb82-b0b9fb3d01cd nodeName:}" failed. No retries permitted until 2026-07-09 13:26:48.240812795 +0000 UTC m=+130.210426736 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs") pod "network-metrics-daemon-p974t" (UID: "954e2534-9399-4832-bb82-b0b9fb3d01cd") : secret "metrics-daemon-secret" not found Jul 09 13:25:44.330389 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.330353 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:44.333062 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.333042 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 13:25:44.343273 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.343250 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79725ec9-6a1a-4e7f-8af6-e440a26629ce-original-pull-secret\") pod \"global-pull-secret-syncer-c2dlc\" (UID: \"79725ec9-6a1a-4e7f-8af6-e440a26629ce\") " pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:44.375633 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.375605 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2dlc" Jul 09 13:25:44.431399 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.431369 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:44.434214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.434184 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 13:25:44.445106 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.445081 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 13:25:44.455935 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.455907 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt279\" (UniqueName: \"kubernetes.io/projected/db5923df-bf11-40df-975c-201cd269f083-kube-api-access-kt279\") pod \"network-check-target-zzj74\" (UID: \"db5923df-bf11-40df-975c-201cd269f083\") " pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:44.498145 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.498073 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2dlc"] Jul 09 13:25:44.501071 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:44.501044 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79725ec9_6a1a_4e7f_8af6_e440a26629ce.slice/crio-68df4871cbb7c1be2add228ef49d20921ba45a58583d379160fd6be198b1dd1c WatchSource:0}: Error finding container 68df4871cbb7c1be2add228ef49d20921ba45a58583d379160fd6be198b1dd1c: Status 404 returned error can't find the container with id 68df4871cbb7c1be2add228ef49d20921ba45a58583d379160fd6be198b1dd1c Jul 09 13:25:44.673676 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.673640 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rpg8s\"" Jul 09 13:25:44.681167 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.681129 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:44.808196 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:44.808167 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzj74"] Jul 09 13:25:44.811015 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:44.810973 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5923df_bf11_40df_975c_201cd269f083.slice/crio-a207300db59abb53ee6a219c58088681d9a8eb4a904cb969364e2a418b95331e WatchSource:0}: Error finding container a207300db59abb53ee6a219c58088681d9a8eb4a904cb969364e2a418b95331e: Status 404 returned error can't find the container with id a207300db59abb53ee6a219c58088681d9a8eb4a904cb969364e2a418b95331e Jul 09 13:25:45.239915 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:45.239872 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:45.240302 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:45.239932 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:45.240302 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:45.240048 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:45.240302 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:45.240125 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.240109686 +0000 UTC m=+75.209723632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:45.240302 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:45.240051 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 13:25:45.240302 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:45.240195 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:25:53.240183432 +0000 UTC m=+75.209797373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : configmap "kube-rbac-proxy" not found Jul 09 13:25:45.315215 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:45.315167 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2dlc" event={"ID":"79725ec9-6a1a-4e7f-8af6-e440a26629ce","Type":"ContainerStarted","Data":"68df4871cbb7c1be2add228ef49d20921ba45a58583d379160fd6be198b1dd1c"} Jul 09 13:25:45.316737 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:45.316704 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzj74" event={"ID":"db5923df-bf11-40df-975c-201cd269f083","Type":"ContainerStarted","Data":"a207300db59abb53ee6a219c58088681d9a8eb4a904cb969364e2a418b95331e"} Jul 09 13:25:46.855480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:46.855441 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:25:46.855908 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:46.855585 2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:46.855908 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:46.855664 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls podName:c5f91285-8777-4422-81d1-20d5ddf8496b nodeName:}" failed. No retries permitted until 2026-07-09 13:26:02.855644263 +0000 UTC m=+84.825258206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-c4242" (UID: "c5f91285-8777-4422-81d1-20d5ddf8496b") : secret "cluster-monitoring-operator-tls" not found Jul 09 13:25:46.956387 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:46.956345 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:46.958757 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:46.958734 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/239a4cc2-b61b-47d6-9f26-9044e4b38804-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sjb4\" (UID: \"239a4cc2-b61b-47d6-9f26-9044e4b38804\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:47.027901 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.027869 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tm8kv\"" Jul 09 13:25:47.035306 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.035280 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" Jul 09 13:25:47.179500 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.179417 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4"] Jul 09 13:25:47.322815 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.322774 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" event={"ID":"239a4cc2-b61b-47d6-9f26-9044e4b38804","Type":"ContainerStarted","Data":"dfe9bacd4123af7e591f77ba67ada44f55511ac806500cd3db5317bdc41ce365"} Jul 09 13:25:47.761985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.761940 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:47.762144 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.762041 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:47.764914 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.764883 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/90c8ad8c-83ae-42e2-825d-3212d1aea1cf-metrics-tls\") pod \"dns-default-mmmc7\" (UID: \"90c8ad8c-83ae-42e2-825d-3212d1aea1cf\") " pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:47.765055 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:47.764972 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"image-registry-6bd45f9d48-cmsrt\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:48.022266 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:48.022184 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7vrwn\"" Jul 09 13:25:48.029792 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:48.029762 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:48.032190 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:48.032161 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8c6wn\"" Jul 09 13:25:48.040025 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:48.039993 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:50.332908 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.332790 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" event={"ID":"239a4cc2-b61b-47d6-9f26-9044e4b38804","Type":"ContainerStarted","Data":"9755cd326b856153a71cee5a808626a22711e59cb666371ca57b157fd9d7b3db"} Jul 09 13:25:50.334457 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.334400 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzj74" event={"ID":"db5923df-bf11-40df-975c-201cd269f083","Type":"ContainerStarted","Data":"5b33cc6ce034f3f224e31ad97149b59c9c5b4159dddd7fbba07878b30ae90c69"} Jul 09 13:25:50.334687 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.334670 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:25:50.344216 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.344059 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mmmc7"] Jul 09 13:25:50.350310 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:50.350278 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c8ad8c_83ae_42e2_825d_3212d1aea1cf.slice/crio-cb8b0496331a941a549fa1377a1246b4013db69e857e9763978401eefe8abf69 WatchSource:0}: Error finding container cb8b0496331a941a549fa1377a1246b4013db69e857e9763978401eefe8abf69: Status 404 returned error can't find the container with id cb8b0496331a941a549fa1377a1246b4013db69e857e9763978401eefe8abf69 Jul 09 13:25:50.355244 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.355193 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zzj74" podStartSLOduration=64.989309147 podStartE2EDuration="1m10.355060104s" totalImagesPullingTime="5.365750957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:50.354615841 +0000 UTC m=+72.324229805" watchObservedRunningTime="2026-07-09 13:25:50.355060104 +0000 UTC m=+72.324674065" Jul 09 13:25:50.361181 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:50.360993 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:25:50.365555 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:25:50.365492 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b156b07_b28e_4ce8_b5ae_3122654c17e7.slice/crio-9c03a69e88ff9fbb82f1cdc33afb4b4b80961e4b9697769e5b293cc0db9c9a1a WatchSource:0}: Error finding container 9c03a69e88ff9fbb82f1cdc33afb4b4b80961e4b9697769e5b293cc0db9c9a1a: Status 404 returned error can't find the container with id 9c03a69e88ff9fbb82f1cdc33afb4b4b80961e4b9697769e5b293cc0db9c9a1a Jul 09 13:25:51.340156 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.340105 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" event={"ID":"239a4cc2-b61b-47d6-9f26-9044e4b38804","Type":"ContainerStarted","Data":"a81ccd762c2492aec9ce2ad7cb1f0d43bc66d56e1d55a63124329203efee4679"} Jul 09 13:25:51.341858 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.341832 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2dlc" event={"ID":"79725ec9-6a1a-4e7f-8af6-e440a26629ce","Type":"ContainerStarted","Data":"02ef323572817f67f1b29cd95da271b0fc087051c8b250f88e6accf1a762a306"} Jul 09 13:25:51.343785 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.343695 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" event={"ID":"7b156b07-b28e-4ce8-b5ae-3122654c17e7","Type":"ContainerStarted","Data":"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77"} Jul 09 13:25:51.343785 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.343742 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" event={"ID":"7b156b07-b28e-4ce8-b5ae-3122654c17e7","Type":"ContainerStarted","Data":"9c03a69e88ff9fbb82f1cdc33afb4b4b80961e4b9697769e5b293cc0db9c9a1a"} Jul 09 13:25:51.343785 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.343786 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:25:51.344864 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.344838 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmmc7" event={"ID":"90c8ad8c-83ae-42e2-825d-3212d1aea1cf","Type":"ContainerStarted","Data":"cb8b0496331a941a549fa1377a1246b4013db69e857e9763978401eefe8abf69"} Jul 09 13:25:51.360412 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.360361 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sjb4" podStartSLOduration=17.376773803 podStartE2EDuration="20.360345199s" totalImagesPullingTime="2.983571396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:51.359531687 +0000 UTC m=+73.329145651" watchObservedRunningTime="2026-07-09 13:25:51.360345199 +0000 UTC m=+73.329959227" Jul 09 13:25:51.376284 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.376231 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c2dlc" podStartSLOduration=65.67068033 podStartE2EDuration="1m11.376215011s" totalImagesPullingTime="5.705534681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:51.375485189 +0000 UTC m=+73.345099154" watchObservedRunningTime="2026-07-09 13:25:51.376215011 +0000 UTC m=+73.345828975" Jul 09 13:25:51.395577 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:51.395512 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" podStartSLOduration=71.395494603 podStartE2EDuration="1m11.395494603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:51.394582395 +0000 UTC m=+73.364196359" watchObservedRunningTime="2026-07-09 13:25:51.395494603 +0000 UTC m=+73.365108566" Jul 09 13:25:53.307273 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.307242 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:53.307645 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.307284 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:53.307645 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:53.307390 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 13:25:53.307645 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:25:53.307458 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls podName:9a521e97-25a4-4bf6-82d9-e86912946ed5 nodeName:}" failed. No retries permitted until 2026-07-09 13:26:09.307441074 +0000 UTC m=+91.277055036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ljfwb" (UID: "9a521e97-25a4-4bf6-82d9-e86912946ed5") : secret "insights-runtime-extractor-tls" not found Jul 09 13:25:53.307804 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.307789 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a521e97-25a4-4bf6-82d9-e86912946ed5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:25:53.354843 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.354800 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmmc7" event={"ID":"90c8ad8c-83ae-42e2-825d-3212d1aea1cf","Type":"ContainerStarted","Data":"f7ed89160a6fc90077315495711d2fd6611aa8457bb12128bba13bb0b752d78f"} Jul 09 13:25:53.355011 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.354862 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mmmc7" event={"ID":"90c8ad8c-83ae-42e2-825d-3212d1aea1cf","Type":"ContainerStarted","Data":"ad6a45acd1cab4a8a4b5c8d26bcd2546e4b240f519d820691fca0cf4b6947df8"} Jul 09 13:25:53.355011 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.354899 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mmmc7" Jul 09 13:25:53.378156 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:25:53.378103 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mmmc7" podStartSLOduration=35.690923703 podStartE2EDuration="38.378058179s" totalImagesPullingTime="2.687134476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:25:53.37678682 +0000 UTC m=+75.346400785" watchObservedRunningTime="2026-07-09 13:25:53.378058179 +0000 UTC m=+75.347672144" Jul 09 13:26:02.857435 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.857276 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq"] Jul 09 13:26:02.859775 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.859760 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.862470 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.862445 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 13:26:02.862628 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.862566 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 13:26:02.863477 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.863454 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 13:26:02.863477 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.863482 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 13:26:02.863660 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.863542 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 13:26:02.863660 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.863560 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 13:26:02.863769 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.863753 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 13:26:02.882409 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.882384 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:26:02.884788 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.884763 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5f91285-8777-4422-81d1-20d5ddf8496b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-c4242\" (UID: \"c5f91285-8777-4422-81d1-20d5ddf8496b\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:26:02.888823 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.888794 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq"] Jul 09 13:26:02.909805 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.906557 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8m2n9\"" Jul 09 13:26:02.911591 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.911572 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" Jul 09 13:26:02.982963 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.982925 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.983134 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.983000 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.983134 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.983064 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bba02be1-7898-4467-a9e2-9b17062216f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.983134 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.983096 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.983278 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.983140 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z4vf\" (UniqueName: \"kubernetes.io/projected/bba02be1-7898-4467-a9e2-9b17062216f4-kube-api-access-4z4vf\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:02.983278 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:02.983184 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.043836 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.043777 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242"] Jul 09 13:26:03.045769 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:03.045731 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f91285_8777_4422_81d1_20d5ddf8496b.slice/crio-d5f196e96eee0288bfa1c6517aa52ad40782032dede59a3618006d36cd279f6a WatchSource:0}: Error finding container d5f196e96eee0288bfa1c6517aa52ad40782032dede59a3618006d36cd279f6a: Status 404 returned error can't find the container with id d5f196e96eee0288bfa1c6517aa52ad40782032dede59a3618006d36cd279f6a Jul 09 13:26:03.083678 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083643 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z4vf\" (UniqueName: \"kubernetes.io/projected/bba02be1-7898-4467-a9e2-9b17062216f4-kube-api-access-4z4vf\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.083678 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083682 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.083939 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083721 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.083939 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083751 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.083939 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083779 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bba02be1-7898-4467-a9e2-9b17062216f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.083939 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.083795 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.084630 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.084600 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bba02be1-7898-4467-a9e2-9b17062216f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.086580 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.086550 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-ca\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.086699 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.086654 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.086699 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.086659 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.086809 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.086738 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bba02be1-7898-4467-a9e2-9b17062216f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.094803 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.094783 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z4vf\" (UniqueName: \"kubernetes.io/projected/bba02be1-7898-4467-a9e2-9b17062216f4-kube-api-access-4z4vf\") pod \"cluster-proxy-proxy-agent-6bf4498f9c-z92kq\" (UID: \"bba02be1-7898-4467-a9e2-9b17062216f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.179453 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.179423 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" Jul 09 13:26:03.315478 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.315210 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq"] Jul 09 13:26:03.359467 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.359440 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mmmc7" Jul 09 13:26:03.386299 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.386264 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" event={"ID":"bba02be1-7898-4467-a9e2-9b17062216f4","Type":"ContainerStarted","Data":"6334fd624db6f713bf5901b6a073d9e39428c3bfe6978beeb4706acff3f9122f"} Jul 09 13:26:03.387482 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:03.387455 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" event={"ID":"c5f91285-8777-4422-81d1-20d5ddf8496b","Type":"ContainerStarted","Data":"d5f196e96eee0288bfa1c6517aa52ad40782032dede59a3618006d36cd279f6a"} Jul 09 13:26:07.410850 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.410759 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" event={"ID":"c5f91285-8777-4422-81d1-20d5ddf8496b","Type":"ContainerStarted","Data":"0667e07e9bb1adf0315f3a643d9e0054dd796e1fb6354273df862cc0f784e886"} Jul 09 13:26:07.413682 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.413648 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" event={"ID":"bba02be1-7898-4467-a9e2-9b17062216f4","Type":"ContainerStarted","Data":"f8a0576c214967830b849749aa3f72fccf0a5ad72e9b3a48dfc3dcad4a40b7d6"} Jul 09 13:26:07.413845 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.413696 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" event={"ID":"bba02be1-7898-4467-a9e2-9b17062216f4","Type":"ContainerStarted","Data":"d767c94d8f6e104858b113a297cff727d8ea33d153fa88758a2bd69e0d70a4cd"} Jul 09 13:26:07.413845 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.413716 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" event={"ID":"bba02be1-7898-4467-a9e2-9b17062216f4","Type":"ContainerStarted","Data":"6e71594ab0f762d883cc9ea117cad494b9041d2e0f6b2fdb0bd872f3309cb13a"} Jul 09 13:26:07.430960 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.428978 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-c4242" podStartSLOduration=32.324733234 podStartE2EDuration="36.428919811s" totalImagesPullingTime="4.104186577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:25:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:07.427583687 +0000 UTC m=+89.397197672" watchObservedRunningTime="2026-07-09 13:26:07.428919811 +0000 UTC m=+89.398533777" Jul 09 13:26:07.451687 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:07.451631 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf4498f9c-z92kq" podStartSLOduration=1.604551158 podStartE2EDuration="5.451614226s" totalImagesPullingTime="3.847063068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:07.45122109 +0000 UTC m=+89.420835054" watchObservedRunningTime="2026-07-09 13:26:07.451614226 +0000 UTC m=+89.421228167" Jul 09 13:26:08.034935 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:08.034894 2586 patch_prober.go:28] interesting pod/image-registry-6bd45f9d48-cmsrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 13:26:08.035109 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:08.034950 2586 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 13:26:09.337698 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:09.337658 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:26:09.339989 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:09.339960 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a521e97-25a4-4bf6-82d9-e86912946ed5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ljfwb\" (UID: \"9a521e97-25a4-4bf6-82d9-e86912946ed5\") " pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:26:09.582077 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:09.582038 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fzhd8\"" Jul 09 13:26:09.590263 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:09.590195 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ljfwb" Jul 09 13:26:09.726675 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:09.726509 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ljfwb"] Jul 09 13:26:09.729391 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:09.729364 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a521e97_25a4_4bf6_82d9_e86912946ed5.slice/crio-df1a30b3071b5c33d2a09aeb402008eaded4fb1329b1c622dfe2f359d4e2ca79 WatchSource:0}: Error finding container df1a30b3071b5c33d2a09aeb402008eaded4fb1329b1c622dfe2f359d4e2ca79: Status 404 returned error can't find the container with id df1a30b3071b5c33d2a09aeb402008eaded4fb1329b1c622dfe2f359d4e2ca79 Jul 09 13:26:10.425595 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:10.425554 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljfwb" event={"ID":"9a521e97-25a4-4bf6-82d9-e86912946ed5","Type":"ContainerStarted","Data":"df1a30b3071b5c33d2a09aeb402008eaded4fb1329b1c622dfe2f359d4e2ca79"} Jul 09 13:26:12.356380 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:12.356354 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:26:13.437755 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:13.437587 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljfwb" event={"ID":"9a521e97-25a4-4bf6-82d9-e86912946ed5","Type":"ContainerStarted","Data":"92132e3007cf3dcb56332e70ece64df6ee39db5f372f5d220be218fb40ac1978"} Jul 09 13:26:14.442759 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:14.442727 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljfwb" event={"ID":"9a521e97-25a4-4bf6-82d9-e86912946ed5","Type":"ContainerStarted","Data":"6d543ba4ea42c3f8c4896be3f6b386d12c2d3f2d87c22dcd4787dfd08e6f1060"} Jul 09 13:26:17.456126 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:17.456088 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ljfwb" event={"ID":"9a521e97-25a4-4bf6-82d9-e86912946ed5","Type":"ContainerStarted","Data":"0d2ab521a200e8ddb0608cea7093930c997eac9150108e8714b41d177cc616ec"} Jul 09 13:26:17.480669 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:17.480615 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ljfwb" podStartSLOduration=33.88776135 podStartE2EDuration="40.480599081s" totalImagesPullingTime="6.592837731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:25:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:17.47880419 +0000 UTC m=+99.448418154" watchObservedRunningTime="2026-07-09 13:26:17.480599081 +0000 UTC m=+99.450213046" Jul 09 13:26:21.347972 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:21.347936 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zzj74" Jul 09 13:26:25.150257 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.150207 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctw2w"] Jul 09 13:26:25.184498 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.184462 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.187325 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.187297 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 13:26:25.187469 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.187369 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 13:26:25.188202 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.188181 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z9zql\"" Jul 09 13:26:25.188319 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.188238 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 13:26:25.188319 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.188311 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 13:26:25.312063 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.312031 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:26:25.366908 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.366789 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.366908 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.366836 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-textfile\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.366908 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.366864 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.366931 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-wtmp\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.366961 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-sys\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.367001 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-root\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.367023 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtrl\" (UniqueName: \"kubernetes.io/projected/6863033c-4c9a-4c06-886d-97227446cc0a-kube-api-access-sjtrl\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.367047 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-metrics-client-ca\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.367223 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.367088 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-tls\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.467894 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.467845 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.467907 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-wtmp\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.467937 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-sys\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.467973 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-root\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468026 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-root\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468041 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-sys\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468092 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468049 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtrl\" (UniqueName: \"kubernetes.io/projected/6863033c-4c9a-4c06-886d-97227446cc0a-kube-api-access-sjtrl\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468099 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-metrics-client-ca\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468105 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-wtmp\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468134 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-tls\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468171 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468372 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468189 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-textfile\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468478 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468492 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-textfile\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.468648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.468602 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6863033c-4c9a-4c06-886d-97227446cc0a-metrics-client-ca\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.470462 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.470441 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.470663 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.470645 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6863033c-4c9a-4c06-886d-97227446cc0a-node-exporter-tls\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.483902 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.483875 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtrl\" (UniqueName: \"kubernetes.io/projected/6863033c-4c9a-4c06-886d-97227446cc0a-kube-api-access-sjtrl\") pod \"node-exporter-ctw2w\" (UID: \"6863033c-4c9a-4c06-886d-97227446cc0a\") " pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.493808 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:25.493778 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctw2w" Jul 09 13:26:25.535909 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:25.535881 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6863033c_4c9a_4c06_886d_97227446cc0a.slice/crio-2182e74aeeb0e6a1e8ff2ca525414a58552049f82edebd2fe8132cc1326f83f3 WatchSource:0}: Error finding container 2182e74aeeb0e6a1e8ff2ca525414a58552049f82edebd2fe8132cc1326f83f3: Status 404 returned error can't find the container with id 2182e74aeeb0e6a1e8ff2ca525414a58552049f82edebd2fe8132cc1326f83f3 Jul 09 13:26:26.486098 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:26.486051 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctw2w" event={"ID":"6863033c-4c9a-4c06-886d-97227446cc0a","Type":"ContainerStarted","Data":"2182e74aeeb0e6a1e8ff2ca525414a58552049f82edebd2fe8132cc1326f83f3"} Jul 09 13:26:27.490199 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:27.490163 2586 generic.go:356] "Generic (PLEG): container finished" podID="6863033c-4c9a-4c06-886d-97227446cc0a" containerID="c167f8d02a21dbb4b391a5076e0ab2881f2343852821faf59b5e1d981e31036c" exitCode=0 Jul 09 13:26:27.490643 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:27.490198 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctw2w" event={"ID":"6863033c-4c9a-4c06-886d-97227446cc0a","Type":"ContainerDied","Data":"c167f8d02a21dbb4b391a5076e0ab2881f2343852821faf59b5e1d981e31036c"} Jul 09 13:26:28.496240 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:28.496205 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctw2w" event={"ID":"6863033c-4c9a-4c06-886d-97227446cc0a","Type":"ContainerStarted","Data":"e656e2364ab3c1173b9ae7d68ba86a4c8eeb7706f7e439fce1537fe90c43d9fb"} Jul 09 13:26:28.496695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:28.496262 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctw2w" event={"ID":"6863033c-4c9a-4c06-886d-97227446cc0a","Type":"ContainerStarted","Data":"e6aeb01f24e0024550abc72d7a9ae124700fd567586bc6896899cc4d20cbe255"} Jul 09 13:26:29.474617 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.474558 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctw2w" podStartSLOduration=3.243099703 podStartE2EDuration="4.474538374s" totalImagesPullingTime="1.164066899s" totalInitContainerRuntime="67.371772ms" isStatefulPod=true podCreationTimestamp="2026-07-09 13:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:28.519065681 +0000 UTC m=+110.488679644" watchObservedRunningTime="2026-07-09 13:26:29.474538374 +0000 UTC m=+111.444152329" Jul 09 13:26:29.475382 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.475357 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7687c596-fp62r"] Jul 09 13:26:29.478043 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.478024 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.480736 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.480711 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 13:26:29.480841 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.480773 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 13:26:29.482330 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.482304 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9i2ugdosrevh1\"" Jul 09 13:26:29.482437 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.482371 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tg6zm\"" Jul 09 13:26:29.482584 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.482563 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 13:26:29.482782 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.482763 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 13:26:29.489327 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.489306 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7687c596-fp62r"] Jul 09 13:26:29.498944 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.498919 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnds6\" (UniqueName: \"kubernetes.io/projected/b8037c62-79c0-47ef-b39e-af9d34f0e583-kube-api-access-wnds6\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.498951 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.499010 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-client-certs\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.499028 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-metrics-server-audit-profiles\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.499050 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8037c62-79c0-47ef-b39e-af9d34f0e583-audit-log\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.499143 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-tls\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.499211 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.499183 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-client-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.599821 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.599782 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnds6\" (UniqueName: \"kubernetes.io/projected/b8037c62-79c0-47ef-b39e-af9d34f0e583-kube-api-access-wnds6\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.599821 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.599817 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.599886 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-client-certs\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.599913 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-metrics-server-audit-profiles\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.599940 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8037c62-79c0-47ef-b39e-af9d34f0e583-audit-log\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.600004 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-tls\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600078 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.600047 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-client-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.600464 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8037c62-79c0-47ef-b39e-af9d34f0e583-audit-log\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.600626 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.600588 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.601100 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.601067 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8037c62-79c0-47ef-b39e-af9d34f0e583-metrics-server-audit-profiles\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.602573 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.602549 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-client-certs\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.602675 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.602588 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-secret-metrics-server-tls\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.603015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.602990 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8037c62-79c0-47ef-b39e-af9d34f0e583-client-ca-bundle\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.615748 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.615714 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnds6\" (UniqueName: \"kubernetes.io/projected/b8037c62-79c0-47ef-b39e-af9d34f0e583-kube-api-access-wnds6\") pod \"metrics-server-7687c596-fp62r\" (UID: \"b8037c62-79c0-47ef-b39e-af9d34f0e583\") " pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.789844 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.789750 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:29.938051 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.938022 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7687c596-fp62r"] Jul 09 13:26:29.941128 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:29.941096 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8037c62_79c0_47ef_b39e_af9d34f0e583.slice/crio-c9927fa9c2b6e3d9c75bf159e80b06d18830105d8b36e4b67781a2c5b4c0be13 WatchSource:0}: Error finding container c9927fa9c2b6e3d9c75bf159e80b06d18830105d8b36e4b67781a2c5b4c0be13: Status 404 returned error can't find the container with id c9927fa9c2b6e3d9c75bf159e80b06d18830105d8b36e4b67781a2c5b4c0be13 Jul 09 13:26:29.958388 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.958359 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh"] Jul 09 13:26:29.962567 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.962547 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:29.965568 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.965544 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-77n5z\"" Jul 09 13:26:29.965662 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.965604 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 13:26:29.978101 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:29.978077 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh"] Jul 09 13:26:30.002308 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.002273 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpvx\" (UniqueName: \"kubernetes.io/projected/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-kube-api-access-2bpvx\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.002486 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.002402 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.103408 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.103305 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.103408 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.103357 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpvx\" (UniqueName: \"kubernetes.io/projected/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-kube-api-access-2bpvx\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.103671 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:26:30.103447 2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 13:26:30.103671 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:26:30.103535 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert podName:e0178f40-c93b-4c1b-b5f5-a7c88d74ebde nodeName:}" failed. No retries permitted until 2026-07-09 13:26:30.603496093 +0000 UTC m=+112.573110035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-z5qdh" (UID: "e0178f40-c93b-4c1b-b5f5-a7c88d74ebde") : secret "monitoring-plugin-cert" not found Jul 09 13:26:30.112015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.111992 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpvx\" (UniqueName: \"kubernetes.io/projected/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-kube-api-access-2bpvx\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.503962 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.503927 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7687c596-fp62r" event={"ID":"b8037c62-79c0-47ef-b39e-af9d34f0e583","Type":"ContainerStarted","Data":"c9927fa9c2b6e3d9c75bf159e80b06d18830105d8b36e4b67781a2c5b4c0be13"} Jul 09 13:26:30.607452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.607410 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.610786 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.610755 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0178f40-c93b-4c1b-b5f5-a7c88d74ebde-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-z5qdh\" (UID: \"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:30.872139 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:30.872041 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:31.010674 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.010643 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh"] Jul 09 13:26:31.013160 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:31.013133 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0178f40_c93b_4c1b_b5f5_a7c88d74ebde.slice/crio-4a89d48c2177a138c83789d54b0c63e704d8fcf3b90b76cc9b49fd9b2f2ad0b1 WatchSource:0}: Error finding container 4a89d48c2177a138c83789d54b0c63e704d8fcf3b90b76cc9b49fd9b2f2ad0b1: Status 404 returned error can't find the container with id 4a89d48c2177a138c83789d54b0c63e704d8fcf3b90b76cc9b49fd9b2f2ad0b1 Jul 09 13:26:31.474300 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.474269 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 13:26:31.478956 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.478935 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.481636 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.481610 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 13:26:31.482749 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.482725 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 13:26:31.482749 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.482741 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 13:26:31.482872 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.482773 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 13:26:31.482872 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.482778 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 13:26:31.483085 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483069 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 13:26:31.483191 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483173 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 13:26:31.483232 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483185 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 13:26:31.483551 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483533 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 13:26:31.483986 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483971 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qx6cs\"" Jul 09 13:26:31.484136 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.483992 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 13:26:31.484136 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.484100 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 13:26:31.484507 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.484495 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8q7fpmmhnbhee\"" Jul 09 13:26:31.484739 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.484728 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 13:26:31.485025 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.485013 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 13:26:31.487360 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.487343 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 13:26:31.497855 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.497835 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 13:26:31.509040 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.509009 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" event={"ID":"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde","Type":"ContainerStarted","Data":"4a89d48c2177a138c83789d54b0c63e704d8fcf3b90b76cc9b49fd9b2f2ad0b1"} Jul 09 13:26:31.513940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.513921 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.513948 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.513969 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.513988 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514054 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514029 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514062 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514090 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514116 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514131 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514214 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514145 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514206 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514258 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514294 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514325 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514351 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514455 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514445 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514744 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514474 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6662d\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-kube-api-access-6662d\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514744 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514505 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514744 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514549 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.514744 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.514585 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615753 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615710 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615763 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6662d\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-kube-api-access-6662d\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615791 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615818 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615856 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615884 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615911 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.615940 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615932 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616264 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.615960 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616571 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616629 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616659 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616712 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616744 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616774 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616814 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616823 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616866 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616904 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616941 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.616985 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616970 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.617409 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.616973 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.617461 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.617448 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.618378 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.618326 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.622307 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.621761 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.622307 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.621994 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.622641 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.622974 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.623157 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.623406 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-web-config\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.623862 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.625577 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.626243 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6662d\" (UniqueName: \"kubernetes.io/projected/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-kube-api-access-6662d\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.626488 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-config-out\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.626953 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.626928 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.627025 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.626949 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.628060 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.627221 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.628060 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.627378 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.628060 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.627594 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.628886 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.628865 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9e9cdf0f-eec1-4ab0-a5cc-08b292371659-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9e9cdf0f-eec1-4ab0-a5cc-08b292371659\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:31.851500 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:31.851416 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:32.007855 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:32.007824 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 13:26:32.010108 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:32.010080 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e9cdf0f_eec1_4ab0_a5cc_08b292371659.slice/crio-e9d3fd584684af5dda699da910757a73df11c5c712bbf9459713339f8d622a71 WatchSource:0}: Error finding container e9d3fd584684af5dda699da910757a73df11c5c712bbf9459713339f8d622a71: Status 404 returned error can't find the container with id e9d3fd584684af5dda699da910757a73df11c5c712bbf9459713339f8d622a71 Jul 09 13:26:32.514404 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:32.514359 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7687c596-fp62r" event={"ID":"b8037c62-79c0-47ef-b39e-af9d34f0e583","Type":"ContainerStarted","Data":"bd2e1bbb7347b6c4f9ea9548f2d18cc42cdbbe801d503165e0a1273e22aacce9"} Jul 09 13:26:32.515568 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:32.515544 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"e9d3fd584684af5dda699da910757a73df11c5c712bbf9459713339f8d622a71"} Jul 09 13:26:32.534851 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:32.534804 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7687c596-fp62r" podStartSLOduration=2.0149376 podStartE2EDuration="3.53478865s" totalImagesPullingTime="1.51985105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:32.533832032 +0000 UTC m=+114.503445997" watchObservedRunningTime="2026-07-09 13:26:32.53478865 +0000 UTC m=+114.504402614" Jul 09 13:26:33.521100 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.521051 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" event={"ID":"e0178f40-c93b-4c1b-b5f5-a7c88d74ebde","Type":"ContainerStarted","Data":"248ed5511df02a8f021bc7e2d0fc4664d2b2b1c88508e7390f086a01baeef8a9"} Jul 09 13:26:33.521575 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.521111 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:33.522723 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.522698 2586 generic.go:356] "Generic (PLEG): container finished" podID="9e9cdf0f-eec1-4ab0-a5cc-08b292371659" containerID="f7080718d5dd8ff4c2ba70eae1f9b4be1a436783162e2085070f3b9fb05ca4cb" exitCode=0 Jul 09 13:26:33.522856 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.522795 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerDied","Data":"f7080718d5dd8ff4c2ba70eae1f9b4be1a436783162e2085070f3b9fb05ca4cb"} Jul 09 13:26:33.526343 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.526319 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" Jul 09 13:26:33.548198 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:33.548158 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-z5qdh" podStartSLOduration=2.993190527 podStartE2EDuration="4.548145076s" totalImagesPullingTime="1.554954549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:33.548003023 +0000 UTC m=+115.517616986" watchObservedRunningTime="2026-07-09 13:26:33.548145076 +0000 UTC m=+115.517759040" Jul 09 13:26:38.544016 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:38.543966 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"e7019867d985c891a850ec499da2a648e506466c6837424c37a0373b0345b71f"} Jul 09 13:26:38.544400 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:38.544049 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"da033ec5e0b8fc2ee04801822b9cb1206e57de96e163f296291b970d5fee2e36"} Jul 09 13:26:40.554837 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:40.554798 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"d89c92800b948dc62e427bb4517011e3e03fe00fc46394b32c108fa8ba49ed40"} Jul 09 13:26:40.555259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:40.554887 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"e707767184e46152b3f5a847f923dad54772c7e50b67a094b69bccdf46401383"} Jul 09 13:26:40.555259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:40.554929 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"1d2927f93264af14f669323df12961ec465c2551ea8bf4be0edb4f7ff19e1f96"} Jul 09 13:26:40.555259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:40.554968 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9e9cdf0f-eec1-4ab0-a5cc-08b292371659","Type":"ContainerStarted","Data":"39bf21f605d98feb6e1939028bd1be764ed084b22887550b9ce57f4dbc6a9d60"} Jul 09 13:26:40.643933 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:40.643876 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.230036084 podStartE2EDuration="9.643857751s" totalImagesPullingTime="7.39163344s" totalInitContainerRuntime="22.188227ms" isStatefulPod=false podCreationTimestamp="2026-07-09 13:26:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:40.643014777 +0000 UTC m=+122.612628763" watchObservedRunningTime="2026-07-09 13:26:40.643857751 +0000 UTC m=+122.613471726" Jul 09 13:26:41.852018 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:41.851977 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:26:48.264102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:48.264044 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:26:48.266360 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:48.266338 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/954e2534-9399-4832-bb82-b0b9fb3d01cd-metrics-certs\") pod \"network-metrics-daemon-p974t\" (UID: \"954e2534-9399-4832-bb82-b0b9fb3d01cd\") " pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:26:48.468315 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:48.468279 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gn99p\"" Jul 09 13:26:48.475747 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:48.475731 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p974t" Jul 09 13:26:48.636351 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:48.636317 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p974t"] Jul 09 13:26:48.639325 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:26:48.639303 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod954e2534_9399_4832_bb82_b0b9fb3d01cd.slice/crio-75c6d4686ad52187ca6139ce62faa600fe54bb19c228e2e423295a9cf5c5a1f8 WatchSource:0}: Error finding container 75c6d4686ad52187ca6139ce62faa600fe54bb19c228e2e423295a9cf5c5a1f8: Status 404 returned error can't find the container with id 75c6d4686ad52187ca6139ce62faa600fe54bb19c228e2e423295a9cf5c5a1f8 Jul 09 13:26:49.590696 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:49.590650 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p974t" event={"ID":"954e2534-9399-4832-bb82-b0b9fb3d01cd","Type":"ContainerStarted","Data":"75c6d4686ad52187ca6139ce62faa600fe54bb19c228e2e423295a9cf5c5a1f8"} Jul 09 13:26:49.790358 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:49.790327 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:49.790542 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:49.790412 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:26:50.333158 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.333078 2586 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerName="registry" containerID="cri-o://c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77" gracePeriod=30 Jul 09 13:26:50.590008 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.589946 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:26:50.595886 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.595856 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p974t" event={"ID":"954e2534-9399-4832-bb82-b0b9fb3d01cd","Type":"ContainerStarted","Data":"c9f7bcbddad236e7398e367fd9a55d7675b05b4b3d32531ae1953d8edf6b1cbf"} Jul 09 13:26:50.596243 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.595918 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p974t" event={"ID":"954e2534-9399-4832-bb82-b0b9fb3d01cd","Type":"ContainerStarted","Data":"35fd6d54ce9e23c195242ea1c3ed4af08ef7aeb4ce8e09518bf3faa97be176e8"} Jul 09 13:26:50.597058 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.597036 2586 generic.go:356] "Generic (PLEG): container finished" podID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerID="c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77" exitCode=0 Jul 09 13:26:50.597141 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.597074 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" Jul 09 13:26:50.597141 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.597094 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" event={"ID":"7b156b07-b28e-4ce8-b5ae-3122654c17e7","Type":"ContainerDied","Data":"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77"} Jul 09 13:26:50.597141 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.597127 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bd45f9d48-cmsrt" event={"ID":"7b156b07-b28e-4ce8-b5ae-3122654c17e7","Type":"ContainerDied","Data":"9c03a69e88ff9fbb82f1cdc33afb4b4b80961e4b9697769e5b293cc0db9c9a1a"} Jul 09 13:26:50.597233 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.597164 2586 scope.go:117] "RemoveContainer" containerID="c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77" Jul 09 13:26:50.604905 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.604888 2586 scope.go:117] "RemoveContainer" containerID="c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77" Jul 09 13:26:50.605157 ip-10-0-128-102 kubenswrapper[2586]: E0709 13:26:50.605139 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77\": container with ID starting with c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77 not found: ID does not exist" containerID="c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77" Jul 09 13:26:50.605200 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.605167 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77"} err="failed to get container status \"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77\": rpc error: code = NotFound desc = could not find container \"c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77\": container with ID starting with c1668936b7bfb544843436be7691dc389bf4eef3190fd3759e090767b5283a77 not found: ID does not exist" Jul 09 13:26:50.628635 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.628573 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p974t" podStartSLOduration=130.599480386 podStartE2EDuration="2m11.628550668s" totalImagesPullingTime="1.029070282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:24:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:26:50.627388743 +0000 UTC m=+132.597002713" watchObservedRunningTime="2026-07-09 13:26:50.628550668 +0000 UTC m=+132.598164634" Jul 09 13:26:50.684273 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684234 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684288 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684312 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684334 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684353 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684399 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684456 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684421 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684794 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684657 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmwzk\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk\") pod \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\" (UID: \"7b156b07-b28e-4ce8-b5ae-3122654c17e7\") " Jul 09 13:26:50.684951 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684927 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:50.685015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.684952 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 13:26:50.687249 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.687213 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:50.687352 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.687262 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:50.687352 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.687345 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:50.687473 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.687451 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk" (OuterVolumeSpecName: "kube-api-access-jmwzk") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "kube-api-access-jmwzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 13:26:50.687630 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.687610 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 13:26:50.693164 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.693142 2586 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7b156b07-b28e-4ce8-b5ae-3122654c17e7" (UID: "7b156b07-b28e-4ce8-b5ae-3122654c17e7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 13:26:50.786049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.785996 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-trusted-ca\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786042 2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b156b07-b28e-4ce8-b5ae-3122654c17e7-ca-trust-extracted\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786051 2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-installation-pull-secrets\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786060 2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-bound-sa-token\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786049 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786069 2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b156b07-b28e-4ce8-b5ae-3122654c17e7-image-registry-private-configuration\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786336 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786077 2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-certificates\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786336 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786085 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmwzk\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-kube-api-access-jmwzk\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.786336 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.786093 2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b156b07-b28e-4ce8-b5ae-3122654c17e7-registry-tls\") on node \"ip-10-0-128-102.ec2.internal\" DevicePath \"\"" Jul 09 13:26:50.919608 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.919578 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:26:50.923965 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:50.923937 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bd45f9d48-cmsrt"] Jul 09 13:26:51.061061 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:26:51.061025 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" path="/var/lib/kubelet/pods/7b156b07-b28e-4ce8-b5ae-3122654c17e7/volumes" Jul 09 13:27:00.636142 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:00.636103 2586 generic.go:356] "Generic (PLEG): container finished" podID="798c3854-3b2a-40a0-ba75-1cc1704981ff" containerID="cb6e9e96f4329ab338af539b9ee72164768d99d980c7df6d49db9e64a66f45fb" exitCode=0 Jul 09 13:27:00.636598 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:00.636153 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" event={"ID":"798c3854-3b2a-40a0-ba75-1cc1704981ff","Type":"ContainerDied","Data":"cb6e9e96f4329ab338af539b9ee72164768d99d980c7df6d49db9e64a66f45fb"} Jul 09 13:27:00.636598 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:00.636501 2586 scope.go:117] "RemoveContainer" containerID="cb6e9e96f4329ab338af539b9ee72164768d99d980c7df6d49db9e64a66f45fb" Jul 09 13:27:01.641416 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:01.641383 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-nhg9z" event={"ID":"798c3854-3b2a-40a0-ba75-1cc1704981ff","Type":"ContainerStarted","Data":"4e70a611439ada18cdd1de4844265bbf53d4937bf6034da2ba9f53be272e4b7b"} Jul 09 13:27:09.795131 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:09.795102 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:27:09.799564 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:09.799534 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7687c596-fp62r" Jul 09 13:27:31.852416 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:31.852314 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:27:31.871429 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:31.871395 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:27:32.773107 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:27:32.773081 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 13:29:38.429182 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:29:38.429155 2586 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 13:30:08.195255 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.195221 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d"] Jul 09 13:30:08.197731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.195499 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerName="registry" Jul 09 13:30:08.197731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.195510 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerName="registry" Jul 09 13:30:08.197731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.195577 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b156b07-b28e-4ce8-b5ae-3122654c17e7" containerName="registry" Jul 09 13:30:08.198660 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.198644 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.202864 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.202843 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 13:30:08.203009 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.202871 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 13:30:08.203409 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.203387 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 13:30:08.203492 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.203425 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kp2fp\"" Jul 09 13:30:08.204366 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.204342 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 13:30:08.221155 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.221124 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d"] Jul 09 13:30:08.285842 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.285807 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.285842 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.285852 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4795j\" (UniqueName: \"kubernetes.io/projected/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-kube-api-access-4795j\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.286077 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.285876 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.286077 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.285892 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.286077 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.285969 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387086 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387050 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387086 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387087 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4795j\" (UniqueName: \"kubernetes.io/projected/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-kube-api-access-4795j\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387345 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387113 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387345 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387129 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387345 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.387682 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.387662 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-manifests\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.389419 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.389401 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-tmp\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.389695 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.389680 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.389764 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.389744 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.404753 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.404724 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4795j\" (UniqueName: \"kubernetes.io/projected/7ba9553d-d1cb-47e9-bc36-e2fdd28d637a-kube-api-access-4795j\") pod \"opendatahub-operator-controller-manager-78c95977c-4522d\" (UID: \"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a\") " pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.509015 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.508921 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:08.651809 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.651670 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d"] Jul 09 13:30:08.654598 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:30:08.654570 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba9553d_d1cb_47e9_bc36_e2fdd28d637a.slice/crio-ad94bbd0d3d352d53dcb5a9cda977ecf9479dfa90f4179eee4de8ad06ad4e6b0 WatchSource:0}: Error finding container ad94bbd0d3d352d53dcb5a9cda977ecf9479dfa90f4179eee4de8ad06ad4e6b0: Status 404 returned error can't find the container with id ad94bbd0d3d352d53dcb5a9cda977ecf9479dfa90f4179eee4de8ad06ad4e6b0 Jul 09 13:30:08.656724 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:08.656707 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 13:30:09.314689 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:09.314657 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" event={"ID":"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a","Type":"ContainerStarted","Data":"ad94bbd0d3d352d53dcb5a9cda977ecf9479dfa90f4179eee4de8ad06ad4e6b0"} Jul 09 13:30:12.329174 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:12.329131 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" event={"ID":"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a","Type":"ContainerStarted","Data":"70c133d1b8f368152669c85b10e0d57973e0b591f07b846b9abeb9475696f795"} Jul 09 13:30:13.334815 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:13.334730 2586 generic.go:356] "Generic (PLEG): container finished" podID="7ba9553d-d1cb-47e9-bc36-e2fdd28d637a" containerID="70c133d1b8f368152669c85b10e0d57973e0b591f07b846b9abeb9475696f795" exitCode=0 Jul 09 13:30:13.334815 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:13.334792 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" event={"ID":"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a","Type":"ContainerDied","Data":"70c133d1b8f368152669c85b10e0d57973e0b591f07b846b9abeb9475696f795"} Jul 09 13:30:14.340504 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:14.340458 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" event={"ID":"7ba9553d-d1cb-47e9-bc36-e2fdd28d637a","Type":"ContainerStarted","Data":"440a692da408018ad6af8ea5f31ad180decb3ed082d0d5c94745996404133927"} Jul 09 13:30:14.340957 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:14.340568 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:14.367084 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:14.367028 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" podStartSLOduration=1.719706993 podStartE2EDuration="6.367012506s" totalImagesPullingTime="3.489145928s" totalInitContainerRuntime="1.158159585s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:14.36454844 +0000 UTC m=+336.334162406" watchObservedRunningTime="2026-07-09 13:30:14.367012506 +0000 UTC m=+336.336626469" Jul 09 13:30:25.347082 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:25.347052 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78c95977c-4522d" Jul 09 13:30:26.364077 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.364040 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj"] Jul 09 13:30:26.374829 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.374796 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.376183 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.376155 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj"] Jul 09 13:30:26.377374 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.377349 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 13:30:26.377493 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.377440 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 13:30:26.378776 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.378748 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 13:30:26.378904 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.378770 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 13:30:26.378904 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.378832 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rzqbm\"" Jul 09 13:30:26.379020 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.378974 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 13:30:26.435973 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.435931 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hsg7\" (UniqueName: \"kubernetes.io/projected/15737eeb-33e6-470c-9a57-0caa0b3c42f0-kube-api-access-8hsg7\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.436153 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.435996 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15737eeb-33e6-470c-9a57-0caa0b3c42f0-manager-config\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.436153 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.436044 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.436153 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.436073 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-metrics-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.537009 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.536894 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hsg7\" (UniqueName: \"kubernetes.io/projected/15737eeb-33e6-470c-9a57-0caa0b3c42f0-kube-api-access-8hsg7\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.537121 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.537070 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15737eeb-33e6-470c-9a57-0caa0b3c42f0-manager-config\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.537121 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.537114 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.537193 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.537147 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-metrics-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.537833 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.537807 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15737eeb-33e6-470c-9a57-0caa0b3c42f0-manager-config\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.539710 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.539689 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.539805 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.539757 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15737eeb-33e6-470c-9a57-0caa0b3c42f0-metrics-cert\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.548127 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.548093 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hsg7\" (UniqueName: \"kubernetes.io/projected/15737eeb-33e6-470c-9a57-0caa0b3c42f0-kube-api-access-8hsg7\") pod \"lws-controller-manager-bcb5676bc-9pdzj\" (UID: \"15737eeb-33e6-470c-9a57-0caa0b3c42f0\") " pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.685921 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.685879 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:26.821198 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:26.821164 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj"] Jul 09 13:30:26.824336 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:30:26.824307 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15737eeb_33e6_470c_9a57_0caa0b3c42f0.slice/crio-3ecedcd456974bda4d81da2e3a446f81e6c89b0f8969f15936a96db35d836059 WatchSource:0}: Error finding container 3ecedcd456974bda4d81da2e3a446f81e6c89b0f8969f15936a96db35d836059: Status 404 returned error can't find the container with id 3ecedcd456974bda4d81da2e3a446f81e6c89b0f8969f15936a96db35d836059 Jul 09 13:30:27.388079 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:27.388035 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" event={"ID":"15737eeb-33e6-470c-9a57-0caa0b3c42f0","Type":"ContainerStarted","Data":"3ecedcd456974bda4d81da2e3a446f81e6c89b0f8969f15936a96db35d836059"} Jul 09 13:30:29.364847 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.364810 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9fdb"] Jul 09 13:30:29.369099 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.369078 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.373119 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.373094 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6lp6h\"" Jul 09 13:30:29.373761 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.373747 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 13:30:29.394659 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.394616 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9fdb"] Jul 09 13:30:29.464376 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.464333 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsg85\" (UniqueName: \"kubernetes.io/projected/1bbea44b-ad6a-4d3c-9595-f2915145d671-kube-api-access-bsg85\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.464578 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.464389 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bbea44b-ad6a-4d3c-9595-f2915145d671-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.565776 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.565731 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bbea44b-ad6a-4d3c-9595-f2915145d671-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.565959 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.565846 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsg85\" (UniqueName: \"kubernetes.io/projected/1bbea44b-ad6a-4d3c-9595-f2915145d671-kube-api-access-bsg85\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.568226 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.568207 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bbea44b-ad6a-4d3c-9595-f2915145d671-tls-certs\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.574731 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.574705 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsg85\" (UniqueName: \"kubernetes.io/projected/1bbea44b-ad6a-4d3c-9595-f2915145d671-kube-api-access-bsg85\") pod \"model-serving-api-54d89bd5fc-m9fdb\" (UID: \"1bbea44b-ad6a-4d3c-9595-f2915145d671\") " pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.679591 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.679553 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:29.810344 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:29.810310 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-m9fdb"] Jul 09 13:30:29.814896 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:30:29.814869 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbea44b_ad6a_4d3c_9595_f2915145d671.slice/crio-bc3563ce677e15073c523a16bd481f45f47707159ef0a37bf7f3fc78ea52ee73 WatchSource:0}: Error finding container bc3563ce677e15073c523a16bd481f45f47707159ef0a37bf7f3fc78ea52ee73: Status 404 returned error can't find the container with id bc3563ce677e15073c523a16bd481f45f47707159ef0a37bf7f3fc78ea52ee73 Jul 09 13:30:30.401765 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:30.401730 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" event={"ID":"1bbea44b-ad6a-4d3c-9595-f2915145d671","Type":"ContainerStarted","Data":"bc3563ce677e15073c523a16bd481f45f47707159ef0a37bf7f3fc78ea52ee73"} Jul 09 13:30:32.415648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:32.415360 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" event={"ID":"1bbea44b-ad6a-4d3c-9595-f2915145d671","Type":"ContainerStarted","Data":"a779ea0d967de6e4ca2b6bd2e39571b48e8b2e6390e1d9831f092a8f5d6d0a4c"} Jul 09 13:30:32.415648 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:32.415474 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:32.438218 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:32.437496 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" podStartSLOduration=1.757271891 podStartE2EDuration="3.437471948s" totalImagesPullingTime="1.680200057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:32.437113509 +0000 UTC m=+354.406727473" watchObservedRunningTime="2026-07-09 13:30:32.437471948 +0000 UTC m=+354.407085914" Jul 09 13:30:34.424129 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:34.424096 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" event={"ID":"15737eeb-33e6-470c-9a57-0caa0b3c42f0","Type":"ContainerStarted","Data":"321425ac672d67a7fb53d62fb481e75584674f3837fdcf9ba7223da36e45b66e"} Jul 09 13:30:34.424512 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:34.424251 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:30:34.443453 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:34.443398 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" podStartSLOduration=1.235661513 podStartE2EDuration="8.443381104s" totalImagesPullingTime="7.207719591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:34.442284742 +0000 UTC m=+356.411898705" watchObservedRunningTime="2026-07-09 13:30:34.443381104 +0000 UTC m=+356.412995126" Jul 09 13:30:35.775814 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.775781 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6"] Jul 09 13:30:35.778973 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.778951 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.781660 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.781625 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 13:30:35.781784 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.781626 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 13:30:35.781784 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.781631 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 13:30:35.781784 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.781693 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z2cld\"" Jul 09 13:30:35.793426 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.793404 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6"] Jul 09 13:30:35.819917 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.819882 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.819939 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.819971 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820031 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820058 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820102 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820082 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820123 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4fzj\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-kube-api-access-q4fzj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820158 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.820259 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.820238 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.920719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920678 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.920719 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920719 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.920970 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920735 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.920970 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920757 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4fzj\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-kube-api-access-q4fzj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.920970 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920881 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921123 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.920972 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921123 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921005 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921123 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921050 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921123 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921074 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921291 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921141 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921323 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921301 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921628 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921602 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921738 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921628 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.921738 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.921611 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.923128 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.923095 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.923385 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.923367 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.932666 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.932636 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4fzj\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-kube-api-access-q4fzj\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.933355 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.933337 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c6ae36-b9a3-4e2d-b962-837e92d01be4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4dv6q6\" (UID: \"16c6ae36-b9a3-4e2d-b962-837e92d01be4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:35.996212 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:35.996172 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc"] Jul 09 13:30:36.000677 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.000653 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.003046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.003025 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 13:30:36.003162 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.003047 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 13:30:36.003162 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.003029 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 13:30:36.003306 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.003294 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bzr8b\"" Jul 09 13:30:36.011797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.011770 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc"] Jul 09 13:30:36.089453 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.089358 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:36.123115 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123074 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123290 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123164 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123290 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123208 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123374 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123303 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/194b21bb-85d1-4b68-9697-288c9137101d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123374 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123334 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123374 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123351 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.123374 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.123365 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbx95\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-kube-api-access-qbx95\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224264 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224223 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224283 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224315 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224355 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/194b21bb-85d1-4b68-9697-288c9137101d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224383 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224405 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.224452 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.224426 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx95\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-kube-api-access-qbx95\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.225234 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.225204 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.226698 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.226670 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/194b21bb-85d1-4b68-9697-288c9137101d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.226820 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.226802 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.226901 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.226817 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.226901 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.226852 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/194b21bb-85d1-4b68-9697-288c9137101d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.237588 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.237560 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.246387 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.246361 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbx95\" (UniqueName: \"kubernetes.io/projected/194b21bb-85d1-4b68-9697-288c9137101d-kube-api-access-qbx95\") pod \"istiod-openshift-gateway-94bb8fbfd-6fntc\" (UID: \"194b21bb-85d1-4b68-9697-288c9137101d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.259238 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:30:36.259209 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c6ae36_b9a3_4e2d_b962_837e92d01be4.slice/crio-329430e38a25429b98a2167db664572017f31a5189f6f79d08c2fa06199eb5af WatchSource:0}: Error finding container 329430e38a25429b98a2167db664572017f31a5189f6f79d08c2fa06199eb5af: Status 404 returned error can't find the container with id 329430e38a25429b98a2167db664572017f31a5189f6f79d08c2fa06199eb5af Jul 09 13:30:36.259652 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.259628 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6"] Jul 09 13:30:36.309919 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.309871 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:36.433281 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.433246 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" event={"ID":"16c6ae36-b9a3-4e2d-b962-837e92d01be4","Type":"ContainerStarted","Data":"329430e38a25429b98a2167db664572017f31a5189f6f79d08c2fa06199eb5af"} Jul 09 13:30:36.450353 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:36.450279 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc"] Jul 09 13:30:36.452460 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:30:36.452435 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194b21bb_85d1_4b68_9697_288c9137101d.slice/crio-380852421b9582705def0ffeafc3278e08dda0ca9d9b4fc820b5caa19e584020 WatchSource:0}: Error finding container 380852421b9582705def0ffeafc3278e08dda0ca9d9b4fc820b5caa19e584020: Status 404 returned error can't find the container with id 380852421b9582705def0ffeafc3278e08dda0ca9d9b4fc820b5caa19e584020 Jul 09 13:30:37.441532 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:37.441476 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" event={"ID":"194b21bb-85d1-4b68-9697-288c9137101d","Type":"ContainerStarted","Data":"380852421b9582705def0ffeafc3278e08dda0ca9d9b4fc820b5caa19e584020"} Jul 09 13:30:38.827795 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:38.827757 2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 13:30:38.828046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:38.827835 2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 13:30:38.828046 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:38.827869 2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 13:30:39.453187 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:39.453149 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" event={"ID":"16c6ae36-b9a3-4e2d-b962-837e92d01be4","Type":"ContainerStarted","Data":"4bc9c260428b28777d5784fd1af97e4bbe3ee514f2f10d3f0078b5e99af2b7fd"} Jul 09 13:30:39.516613 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:39.516502 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" podStartSLOduration=1.9505473580000001 podStartE2EDuration="4.516478337s" totalImagesPullingTime="2.565930979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:39.506787669 +0000 UTC m=+361.476401635" watchObservedRunningTime="2026-07-09 13:30:39.516478337 +0000 UTC m=+361.486092299" Jul 09 13:30:40.079918 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.079877 2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 13:30:40.080220 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.079949 2586 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 13:30:40.089998 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.089967 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:40.094871 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.094846 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:40.460123 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.460086 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" event={"ID":"194b21bb-85d1-4b68-9697-288c9137101d","Type":"ContainerStarted","Data":"55fd2df2d9cb013f10bc8c14227a636d35a16463d92558912f10aed4591da440"} Jul 09 13:30:40.460315 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.460280 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:40.460382 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.460336 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:40.461200 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.461178 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4dv6q6" Jul 09 13:30:40.488587 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:40.488501 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" podStartSLOduration=1.8633629379999999 podStartE2EDuration="5.488480711s" totalImagesPullingTime="3.625117773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 13:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:30:40.488028452 +0000 UTC m=+362.457642408" watchObservedRunningTime="2026-07-09 13:30:40.488480711 +0000 UTC m=+362.458094677" Jul 09 13:30:41.466384 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:41.466356 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-6fntc" Jul 09 13:30:43.423125 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:43.423096 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-m9fdb" Jul 09 13:30:45.429853 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:30:45.429821 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bcb5676bc-9pdzj" Jul 09 13:33:43.615687 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:43.615593 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9fdb_1bbea44b-ad6a-4d3c-9595-f2915145d671/server/0.log" Jul 09 13:33:43.846941 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:43.846913 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-4522d_7ba9553d-d1cb-47e9-bc36-e2fdd28d637a/copy-manifests/0.log" Jul 09 13:33:43.854893 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:43.854867 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-4522d_7ba9553d-d1cb-47e9-bc36-e2fdd28d637a/manager/0.log" Jul 09 13:33:46.816935 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:46.816894 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dv6q6_16c6ae36-b9a3-4e2d-b962-837e92d01be4/istio-proxy/0.log" Jul 09 13:33:46.958862 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:46.958833 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6fntc_194b21bb-85d1-4b68-9697-288c9137101d/discovery/0.log" Jul 09 13:33:54.382812 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:54.382783 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c2dlc_79725ec9-6a1a-4e7f-8af6-e440a26629ce/global-pull-secret-syncer/0.log" Jul 09 13:33:54.541434 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:54.541400 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p22nv_c80fce52-1f97-47bb-ad03-17299f6e8470/konnectivity-agent/0.log" Jul 09 13:33:54.565623 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:33:54.565595 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-102.ec2.internal_440edf1b6fe2a0ad7fefd4e133e5dff2/haproxy/0.log" Jul 09 13:34:01.631626 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:01.631604 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-c4242_c5f91285-8777-4422-81d1-20d5ddf8496b/cluster-monitoring-operator/0.log" Jul 09 13:34:01.763563 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:01.763533 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7687c596-fp62r_b8037c62-79c0-47ef-b39e-af9d34f0e583/metrics-server/0.log" Jul 09 13:34:01.803678 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:01.803641 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-z5qdh_e0178f40-c93b-4c1b-b5f5-a7c88d74ebde/monitoring-plugin/0.log" Jul 09 13:34:01.970630 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:01.970600 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctw2w_6863033c-4c9a-4c06-886d-97227446cc0a/node-exporter/0.log" Jul 09 13:34:01.995808 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:01.995778 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctw2w_6863033c-4c9a-4c06-886d-97227446cc0a/kube-rbac-proxy/0.log" Jul 09 13:34:02.021457 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.021430 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctw2w_6863033c-4c9a-4c06-886d-97227446cc0a/init-textfile/0.log" Jul 09 13:34:02.242987 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.242901 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/prometheus/0.log" Jul 09 13:34:02.268118 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.268089 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/config-reloader/0.log" Jul 09 13:34:02.296108 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.296084 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/thanos-sidecar/0.log" Jul 09 13:34:02.321183 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.321152 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/kube-rbac-proxy-web/0.log" Jul 09 13:34:02.350190 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.350164 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/kube-rbac-proxy/0.log" Jul 09 13:34:02.380017 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.379986 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/kube-rbac-proxy-thanos/0.log" Jul 09 13:34:02.407974 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:02.407948 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9e9cdf0f-eec1-4ab0-a5cc-08b292371659/init-config-reloader/0.log" Jul 09 13:34:04.207788 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.207753 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl"] Jul 09 13:34:04.216800 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.216768 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.219543 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.219496 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbb25\"/\"openshift-service-ca.crt\"" Jul 09 13:34:04.219714 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.219583 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbb25\"/\"kube-root-ca.crt\"" Jul 09 13:34:04.219798 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.219583 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wbb25\"/\"default-dockercfg-t4gpj\"" Jul 09 13:34:04.220253 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.220226 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl"] Jul 09 13:34:04.329317 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.329284 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-podres\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.329317 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.329325 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-lib-modules\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.329576 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.329353 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-sys\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.329576 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.329449 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-proc\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.329576 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.329498 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfv7j\" (UniqueName: \"kubernetes.io/projected/1a608e7a-b97c-472d-a060-88bd453784a4-kube-api-access-kfv7j\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.430797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430757 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-podres\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.430797 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430796 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-lib-modules\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430817 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-sys\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430853 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-proc\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430884 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfv7j\" (UniqueName: \"kubernetes.io/projected/1a608e7a-b97c-472d-a060-88bd453784a4-kube-api-access-kfv7j\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430923 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-lib-modules\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430924 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-podres\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431023 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.430967 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-sys\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.431257 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.431136 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a608e7a-b97c-472d-a060-88bd453784a4-proc\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.438549 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.438510 2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfv7j\" (UniqueName: \"kubernetes.io/projected/1a608e7a-b97c-472d-a060-88bd453784a4-kube-api-access-kfv7j\") pod \"perf-node-gather-daemonset-bnjfl\" (UID: \"1a608e7a-b97c-472d-a060-88bd453784a4\") " pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.527822 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.527731 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:04.659480 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:04.659453 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl"] Jul 09 13:34:04.661795 ip-10-0-128-102 kubenswrapper[2586]: W0709 13:34:04.661761 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a608e7a_b97c_472d_a060_88bd453784a4.slice/crio-1aab1f7004a03842d8b7148d76ea10fd6402f1da5c6ecec46a4ccdf1533f4ad1 WatchSource:0}: Error finding container 1aab1f7004a03842d8b7148d76ea10fd6402f1da5c6ecec46a4ccdf1533f4ad1: Status 404 returned error can't find the container with id 1aab1f7004a03842d8b7148d76ea10fd6402f1da5c6ecec46a4ccdf1533f4ad1 Jul 09 13:34:05.311142 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:05.311106 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" event={"ID":"1a608e7a-b97c-472d-a060-88bd453784a4","Type":"ContainerStarted","Data":"5542b888a710f3ff1d015d9930ad6471640bbfcc096faf7f914035c2dd32696f"} Jul 09 13:34:05.311667 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:05.311157 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" event={"ID":"1a608e7a-b97c-472d-a060-88bd453784a4","Type":"ContainerStarted","Data":"1aab1f7004a03842d8b7148d76ea10fd6402f1da5c6ecec46a4ccdf1533f4ad1"} Jul 09 13:34:05.311667 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:05.311225 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:05.331097 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:05.331043 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" podStartSLOduration=1.331026303 podStartE2EDuration="1.331026303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 13:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 13:34:05.32998644 +0000 UTC m=+567.299600404" watchObservedRunningTime="2026-07-09 13:34:05.331026303 +0000 UTC m=+567.300640267" Jul 09 13:34:07.035804 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:07.035779 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmmc7_90c8ad8c-83ae-42e2-825d-3212d1aea1cf/dns/0.log" Jul 09 13:34:07.062780 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:07.062747 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mmmc7_90c8ad8c-83ae-42e2-825d-3212d1aea1cf/kube-rbac-proxy/0.log" Jul 09 13:34:07.199507 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:07.199472 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd5zg_d186a121-6c73-4135-8378-d23d74ce3278/dns-node-resolver/0.log" Jul 09 13:34:07.847628 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:07.847603 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c5jhw_5dec92cb-878b-4c35-9988-d41e120b1009/node-ca/0.log" Jul 09 13:34:08.859815 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:08.859776 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dv6q6_16c6ae36-b9a3-4e2d-b962-837e92d01be4/istio-proxy/0.log" Jul 09 13:34:08.955460 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:08.955427 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6fntc_194b21bb-85d1-4b68-9697-288c9137101d/discovery/0.log" Jul 09 13:34:09.769129 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:09.769104 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7b9nn_323f4821-77e5-4922-802c-aa2e5375a978/serve-healthcheck-canary/0.log" Jul 09 13:34:10.455262 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:10.455233 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljfwb_9a521e97-25a4-4bf6-82d9-e86912946ed5/kube-rbac-proxy/0.log" Jul 09 13:34:10.486621 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:10.486597 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljfwb_9a521e97-25a4-4bf6-82d9-e86912946ed5/exporter/0.log" Jul 09 13:34:10.514368 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:10.514340 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ljfwb_9a521e97-25a4-4bf6-82d9-e86912946ed5/extractor/0.log" Jul 09 13:34:11.324845 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:11.324816 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wbb25/perf-node-gather-daemonset-bnjfl" Jul 09 13:34:13.106496 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:13.106466 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-m9fdb_1bbea44b-ad6a-4d3c-9595-f2915145d671/server/0.log" Jul 09 13:34:13.239103 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:13.239077 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-4522d_7ba9553d-d1cb-47e9-bc36-e2fdd28d637a/manager/0.log" Jul 09 13:34:13.274065 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:13.274040 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c95977c-4522d_7ba9553d-d1cb-47e9-bc36-e2fdd28d637a/copy-manifests/0.log" Jul 09 13:34:14.790498 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:14.790464 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bcb5676bc-9pdzj_15737eeb-33e6-470c-9a57-0caa0b3c42f0/manager/0.log" Jul 09 13:34:14.917778 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:14.917715 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dv6q6_16c6ae36-b9a3-4e2d-b962-837e92d01be4/istio-proxy/0.log" Jul 09 13:34:14.961798 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:14.961748 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6fntc_194b21bb-85d1-4b68-9697-288c9137101d/discovery/0.log" Jul 09 13:34:16.207124 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:16.207092 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4dv6q6_16c6ae36-b9a3-4e2d-b962-837e92d01be4/istio-proxy/0.log" Jul 09 13:34:16.251947 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:16.251850 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-6fntc_194b21bb-85d1-4b68-9697-288c9137101d/discovery/0.log" Jul 09 13:34:20.824265 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:20.824231 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-nhg9z_798c3854-3b2a-40a0-ba75-1cc1704981ff/kube-storage-version-migrator-operator/1.log" Jul 09 13:34:20.825618 ip-10-0-128-102 kubenswrapper[2586]: I0709 13:34:20.825586 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-nhg9z_798c3854-3b2a-40a0-ba75-1cc1704981ff/kube-storage-version-migrator-operator/0.log"